2026-03-30 12:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 12:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 12:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-30 12:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-30 12:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 12:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 12:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 12:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 12:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: e51646bf41a88a66
2026-03-30 12:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 12:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-30T12_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 12:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 12:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 12:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 12:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 12:00:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 12:00:07 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 12:00:07 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 12:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 12:00:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 12:00:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 12:00:07 [scrapy.core.engine] INFO: Spider opened
2026-03-30 12:00:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:00:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-30 12:00:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-30 12:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 12:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 12:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 12:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 12:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 12:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 12:00:57 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 1021 | hits on page: 40
2026-03-30 12:00:57 [auto1.nl] INFO: Found listing with ID: GZ78686
2026-03-30 12:00:57 [auto1.nl] INFO: Found listing with ID: UA26437
2026-03-30 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA26437%27 HTTP/1.1" 200 None
2026-03-30 12:00:57 [auto1.nl] INFO: Scrape type for UA26437: 1
2026-03-30 12:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:57 [auto1.nl] INFO: Found listing with ID: GY74168
2026-03-30 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY74168%27 HTTP/1.1" 200 None
2026-03-30 12:00:58 [auto1.nl] INFO: Scrape type for GY74168: 1
2026-03-30 12:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:58 [auto1.nl] INFO: Found listing with ID: XZ03488
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ03488%27 HTTP/1.1" 200 None
2026-03-30 12:00:58 [auto1.nl] INFO: Scrape type for XZ03488: 2
2026-03-30 12:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95371af-e35c-5d9d-a4f2-84aa9d80b425 with identifier: XZ03488
2026-03-30 12:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95371af-e35c-5d9d-a4f2-84aa9d80b425 with scrape type 2
2026-03-30 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a95371af-e35c-5d9d-a4f2-84aa9d80b425 with scrape type 2
2026-03-30 12:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a95371af-e35c-5d9d-a4f2-84aa9d80b425, identifier: XZ03488
2026-03-30 12:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a95371af-e35c-5d9d-a4f2-84aa9d80b425 with identifier: XZ03488
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 12:00:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 12:00:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a95371af-e35c-5d9d-a4f2-84aa9d80b425 with identifier: XZ03488
2026-03-30 12:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a95371af-e35c-5d9d-a4f2-84aa9d80b425 with identifier: XZ03488 to the API
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-31T15:27:16Z',
 'fuel_type': 'petrol',
 'id': 'a95371af-e35c-5d9d-a4f2-84aa9d80b425',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ03488',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 277909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-17',
 'seller_name': None,
 'title': 'Volvo V70 2.0 T Edition R-Design',
 'transmission': 'manual',
 'trim': 'Edition R-Design',
 'year': 2011}
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ03488%27 HTTP/1.1" 200 None
2026-03-30 12:00:58 [auto1.nl] INFO: Saving data for XZ03488: {'auction_closing_time': 1774970836.0, 'created_time': 1773688412.633981, 'last_price_update_time': 1774872058.898443}
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XZ03488') HTTP/1.1" 204 0
2026-03-30 12:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:58 [auto1.nl] INFO: Found listing with ID: WN01271
2026-03-30 12:00:58 [auto1.nl] INFO: Found listing with ID: PC48773
2026-03-30 12:00:58 [auto1.nl] INFO: Found listing with ID: JX93234
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX93234%27 HTTP/1.1" 200 None
2026-03-30 12:00:58 [auto1.nl] INFO: Scrape type for JX93234: 2
2026-03-30 12:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2aa9683-8e05-5b4b-8696-ab886f293fbf with identifier: JX93234
2026-03-30 12:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2aa9683-8e05-5b4b-8696-ab886f293fbf with scrape type 2
2026-03-30 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2aa9683-8e05-5b4b-8696-ab886f293fbf with scrape type 2
2026-03-30 12:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2aa9683-8e05-5b4b-8696-ab886f293fbf, identifier: JX93234
2026-03-30 12:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2aa9683-8e05-5b4b-8696-ab886f293fbf with identifier: JX93234
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 12:00:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2aa9683-8e05-5b4b-8696-ab886f293fbf with identifier: JX93234
2026-03-30 12:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2aa9683-8e05-5b4b-8696-ab886f293fbf with identifier: JX93234 to the API
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:18:57Z',
 'fuel_type': 'petrol',
 'id': 'f2aa9683-8e05-5b4b-8696-ab886f293fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX93234',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 200919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX93234%27 HTTP/1.1" 200 None
2026-03-30 12:00:59 [auto1.nl] INFO: Saving data for JX93234: {'auction_closing_time': 1774970337.0, 'created_time': 1774292549.279748, 'last_price_update_time': 1774872059.683155}
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JX93234') HTTP/1.1" 204 0
2026-03-30 12:00:59 [auto1.nl] INFO: Found listing with ID: EF01238
2026-03-30 12:00:59 [auto1.nl] INFO: Found listing with ID: KH11500
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH11500%27 HTTP/1.1" 200 None
2026-03-30 12:00:59 [auto1.nl] INFO: Scrape type for KH11500: 1
2026-03-30 12:00:59 [auto1.nl] INFO: Found listing with ID: LY17744
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY17744%27 HTTP/1.1" 200 None
2026-03-30 12:00:59 [auto1.nl] INFO: Scrape type for LY17744: 2
2026-03-30 12:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 388a1ef1-8620-5b4d-8baa-9019aa79abd3 with identifier: LY17744
2026-03-30 12:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 388a1ef1-8620-5b4d-8baa-9019aa79abd3 with scrape type 2
2026-03-30 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 388a1ef1-8620-5b4d-8baa-9019aa79abd3 with scrape type 2
2026-03-30 12:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 388a1ef1-8620-5b4d-8baa-9019aa79abd3, identifier: LY17744
2026-03-30 12:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 388a1ef1-8620-5b4d-8baa-9019aa79abd3 with identifier: LY17744
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 12:00:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 388a1ef1-8620-5b4d-8baa-9019aa79abd3 with identifier: LY17744
2026-03-30 12:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 388a1ef1-8620-5b4d-8baa-9019aa79abd3 with identifier: LY17744 to the API
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-31T15:39:43Z',
 'fuel_type': 'hybrid',
 'id': '388a1ef1-8620-5b4d-8baa-9019aa79abd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY17744',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 229552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-19',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2016}
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY17744%27 HTTP/1.1" 200 None
2026-03-30 12:01:00 [auto1.nl] INFO: Saving data for LY17744: {'auction_closing_time': 1774971583.0, 'created_time': 1773662654.800398, 'last_price_update_time': 1774872060.356801}
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LY17744') HTTP/1.1" 204 0
2026-03-30 12:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:00 [auto1.nl] INFO: Found listing with ID: DF70778
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF70778%27 HTTP/1.1" 200 None
2026-03-30 12:01:00 [auto1.nl] INFO: Scrape type for DF70778: 1
2026-03-30 12:01:00 [auto1.nl] INFO: Found listing with ID: SE53451
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE53451%27 HTTP/1.1" 200 None
2026-03-30 12:01:00 [auto1.nl] INFO: Scrape type for SE53451: 2
2026-03-30 12:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f2c8aa2-1f3e-5313-aecb-97dfbfbbfa7b with identifier: SE53451
2026-03-30 12:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f2c8aa2-1f3e-5313-aecb-97dfbfbbfa7b with scrape type 2
2026-03-30 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f2c8aa2-1f3e-5313-aecb-97dfbfbbfa7b with scrape type 2
2026-03-30 12:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f2c8aa2-1f3e-5313-aecb-97dfbfbbfa7b, identifier: SE53451
2026-03-30 12:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f2c8aa2-1f3e-5313-aecb-97dfbfbbfa7b with identifier: SE53451
2026-03-30 12:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f2c8aa2-1f3e-5313-aecb-97dfbfbbfa7b with identifier: SE53451
2026-03-30 12:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f2c8aa2-1f3e-5313-aecb-97dfbfbbfa7b with identifier: SE53451 to the API
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:11:25Z',
 'fuel_type': 'petrol',
 'id': '3f2c8aa2-1f3e-5313-aecb-97dfbfbbfa7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE53451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 131554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2018}
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE53451%27 HTTP/1.1" 200 None
2026-03-30 12:01:00 [auto1.nl] INFO: Saving data for SE53451: {'auction_closing_time': 1774969885.0, 'created_time': 1774292571.96456, 'last_price_update_time': 1774872060.847711}
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE53451') HTTP/1.1" 204 0
2026-03-30 12:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:00 [auto1.nl] INFO: Found listing with ID: SV08873
2026-03-30 12:01:00 [auto1.nl] INFO: Found listing with ID: XF31929
2026-03-30 12:01:00 [auto1.nl] INFO: Found listing with ID: GU59213
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU59213%27 HTTP/1.1" 200 None
2026-03-30 12:01:00 [auto1.nl] INFO: Scrape type for GU59213: 1
2026-03-30 12:01:00 [auto1.nl] INFO: Found listing with ID: VR53235
2026-03-30 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR53235%27 HTTP/1.1" 200 None
2026-03-30 12:01:01 [auto1.nl] INFO: Scrape type for VR53235: 2
2026-03-30 12:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4682d5c3-daf7-5f49-8274-5725c0f3ba31 with identifier: VR53235
2026-03-30 12:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4682d5c3-daf7-5f49-8274-5725c0f3ba31 with scrape type 2
2026-03-30 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4682d5c3-daf7-5f49-8274-5725c0f3ba31 with scrape type 2
2026-03-30 12:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4682d5c3-daf7-5f49-8274-5725c0f3ba31, identifier: VR53235
2026-03-30 12:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4682d5c3-daf7-5f49-8274-5725c0f3ba31 with identifier: VR53235
2026-03-30 12:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4682d5c3-daf7-5f49-8274-5725c0f3ba31 with identifier: VR53235
2026-03-30 12:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4682d5c3-daf7-5f49-8274-5725c0f3ba31 with identifier: VR53235 to the API
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:21:36Z',
 'fuel_type': 'petrol',
 'id': '4682d5c3-daf7-5f49-8274-5725c0f3ba31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR53235',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 207008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR53235%27 HTTP/1.1" 200 None
2026-03-30 12:01:01 [auto1.nl] INFO: Saving data for VR53235: {'auction_closing_time': 1774970496.0, 'created_time': 1774292559.164711, 'last_price_update_time': 1774872061.846126}
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VR53235') HTTP/1.1" 204 0
2026-03-30 12:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:01 [auto1.nl] INFO: Found listing with ID: KY22626
2026-03-30 12:01:01 [auto1.nl] INFO: Found listing with ID: KC57622
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC57622%27 HTTP/1.1" 200 None
2026-03-30 12:01:01 [auto1.nl] INFO: Scrape type for KC57622: 1
2026-03-30 12:01:01 [auto1.nl] INFO: Found listing with ID: NJ54414
2026-03-30 12:01:01 [auto1.nl] INFO: Found listing with ID: ZH86542
2026-03-30 12:01:01 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-30 12:01:01 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-30 12:01:01 [auto1.nl] INFO: Scrape type for RX96199: 2
2026-03-30 12:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7b49b0-90d6-5da7-825f-10b72008c875 with identifier: RX96199
2026-03-30 12:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7b49b0-90d6-5da7-825f-10b72008c875 with scrape type 2
2026-03-30 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d7b49b0-90d6-5da7-825f-10b72008c875 with scrape type 2
2026-03-30 12:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9d7b49b0-90d6-5da7-825f-10b72008c875, identifier: RX96199
2026-03-30 12:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9d7b49b0-90d6-5da7-825f-10b72008c875 with identifier: RX96199
2026-03-30 12:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9d7b49b0-90d6-5da7-825f-10b72008c875 with identifier: RX96199
2026-03-30 12:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9d7b49b0-90d6-5da7-825f-10b72008c875 with identifier: RX96199 to the API
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:26:49Z',
 'fuel_type': 'petrol',
 'id': '9d7b49b0-90d6-5da7-825f-10b72008c875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX96199',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 108441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-09',
 'seller_name': None,
 'title': 'Fiat Punto 0.9 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-30 12:01:02 [auto1.nl] INFO: Saving data for RX96199: {'auction_closing_time': 1774970809.0, 'created_time': 1774526460.016744, 'last_price_update_time': 1774872062.375426}
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RX96199') HTTP/1.1" 204 0
2026-03-30 12:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:02 [auto1.nl] INFO: Found listing with ID: DL70871
2026-03-30 12:01:02 [auto1.nl] INFO: Found listing with ID: MA87282
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MA87282%27 HTTP/1.1" 200 None
2026-03-30 12:01:02 [auto1.nl] INFO: Scrape type for MA87282: 1
2026-03-30 12:01:02 [auto1.nl] INFO: Found listing with ID: UP76924
2026-03-30 12:01:02 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-30 12:01:02 [auto1.nl] INFO: Found listing with ID: YB78167
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB78167%27 HTTP/1.1" 200 None
2026-03-30 12:01:02 [auto1.nl] INFO: Scrape type for YB78167: 1
2026-03-30 12:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:02 [auto1.nl] INFO: Found listing with ID: PH19837
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH19837%27 HTTP/1.1" 200 None
2026-03-30 12:01:02 [auto1.nl] INFO: Scrape type for PH19837: 2
2026-03-30 12:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89261190-bdc6-5d3e-b363-ce3c71811420 with identifier: PH19837
2026-03-30 12:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89261190-bdc6-5d3e-b363-ce3c71811420 with scrape type 2
2026-03-30 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89261190-bdc6-5d3e-b363-ce3c71811420 with scrape type 2
2026-03-30 12:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 89261190-bdc6-5d3e-b363-ce3c71811420, identifier: PH19837
2026-03-30 12:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 89261190-bdc6-5d3e-b363-ce3c71811420 with identifier: PH19837
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 12:01:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 89261190-bdc6-5d3e-b363-ce3c71811420 with identifier: PH19837
2026-03-30 12:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 89261190-bdc6-5d3e-b363-ce3c71811420 with identifier: PH19837 to the API
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:07:21Z',
 'fuel_type': 'petrol',
 'id': '89261190-bdc6-5d3e-b363-ce3c71811420',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH19837',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Toledo',
 'odometer': 234274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'Seat Toledo 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH19837%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.nl] INFO: Saving data for PH19837: {'auction_closing_time': 1774969641.0, 'created_time': 1773134145.357998, 'last_price_update_time': 1774872063.0937}
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PH19837') HTTP/1.1" 204 0
2026-03-30 12:01:03 [auto1.nl] INFO: Found listing with ID: VW25358
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW25358%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.nl] INFO: Scrape type for VW25358: 1
2026-03-30 12:01:03 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-30 12:01:03 [auto1.nl] INFO: Found listing with ID: PE66202
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE66202%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.nl] INFO: Scrape type for PE66202: 1
2026-03-30 12:01:03 [auto1.nl] INFO: Found listing with ID: WB81216
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WB81216%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.nl] INFO: Scrape type for WB81216: 1
2026-03-30 12:01:03 [auto1.nl] INFO: Found listing with ID: ER66811
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER66811%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.nl] INFO: Scrape type for ER66811: 1
2026-03-30 12:01:03 [auto1.nl] INFO: Found listing with ID: UY46153
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY46153%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.nl] INFO: Scrape type for UY46153: 1
2026-03-30 12:01:03 [auto1.nl] INFO: Found listing with ID: XN23196
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XN23196%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.nl] INFO: Scrape type for XN23196: 2
2026-03-30 12:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65127294-c8e0-5988-8b65-10b1b5e7571a with identifier: XN23196
2026-03-30 12:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65127294-c8e0-5988-8b65-10b1b5e7571a with scrape type 2
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65127294-c8e0-5988-8b65-10b1b5e7571a with scrape type 2
2026-03-30 12:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 65127294-c8e0-5988-8b65-10b1b5e7571a, identifier: XN23196
2026-03-30 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 65127294-c8e0-5988-8b65-10b1b5e7571a with identifier: XN23196
2026-03-30 12:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 65127294-c8e0-5988-8b65-10b1b5e7571a with identifier: XN23196
2026-03-30 12:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 65127294-c8e0-5988-8b65-10b1b5e7571a with identifier: XN23196 to the API
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:29:50Z',
 'fuel_type': 'petrol',
 'id': '65127294-c8e0-5988-8b65-10b1b5e7571a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN23196',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 108300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XN23196%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.nl] INFO: Saving data for XN23196: {'auction_closing_time': 1774970990.0, 'created_time': 1773133455.370158, 'last_price_update_time': 1774872063.7957}
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XN23196') HTTP/1.1" 204 0
2026-03-30 12:01:03 [auto1.nl] INFO: Found listing with ID: NY67233
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY67233%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.nl] INFO: Scrape type for NY67233: 2
2026-03-30 12:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a35e9a7-125e-585a-8728-95a57f6978f0 with identifier: NY67233
2026-03-30 12:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a35e9a7-125e-585a-8728-95a57f6978f0 with scrape type 2
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a35e9a7-125e-585a-8728-95a57f6978f0 with scrape type 2
2026-03-30 12:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a35e9a7-125e-585a-8728-95a57f6978f0, identifier: NY67233
2026-03-30 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a35e9a7-125e-585a-8728-95a57f6978f0 with identifier: NY67233
2026-03-30 12:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a35e9a7-125e-585a-8728-95a57f6978f0 with identifier: NY67233
2026-03-30 12:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a35e9a7-125e-585a-8728-95a57f6978f0 with identifier: NY67233 to the API
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:22:01Z',
 'fuel_type': 'petrol',
 'id': '1a35e9a7-125e-585a-8728-95a57f6978f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY67233',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 109701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-01',
 'seller_name': None,
 'title': 'BMW 5er 530i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY67233%27 HTTP/1.1" 200 None
2026-03-30 12:01:04 [auto1.nl] INFO: Saving data for NY67233: {'auction_closing_time': 1774970521.0, 'created_time': 1773688149.746231, 'last_price_update_time': 1774872064.267257}
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY67233') HTTP/1.1" 204 0
2026-03-30 12:01:04 [auto1.nl] INFO: Found listing with ID: VL04005
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL04005%27 HTTP/1.1" 200 None
2026-03-30 12:01:04 [auto1.nl] INFO: Scrape type for VL04005: 1
2026-03-30 12:01:04 [auto1.nl] INFO: Found listing with ID: GV35300
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV35300%27 HTTP/1.1" 200 None
2026-03-30 12:01:04 [auto1.nl] INFO: Scrape type for GV35300: 1
2026-03-30 12:01:04 [auto1.nl] INFO: Found listing with ID: WX35760
2026-03-30 12:01:04 [auto1.nl] INFO: Found listing with ID: DR68176
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR68176%27 HTTP/1.1" 200 None
2026-03-30 12:01:04 [auto1.nl] INFO: Scrape type for DR68176: 1
2026-03-30 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC57622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA26437/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:07 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 6 pages/min), scraped 9 items (at 9 items/min)
2026-03-30 12:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 153MiB
2026-03-30 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH11500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE66202/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU59213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB81216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:17 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 1021 | hits on page: 40
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: GZ78686
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: UA26437
2026-03-30 12:01:17 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/UA26437/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: GY74168
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: XZ03488
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ03488%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.nl] INFO: Scrape type for XZ03488: 0
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: WN01271
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: PC48773
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: JX93234
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX93234%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.nl] INFO: Scrape type for JX93234: 0
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: EF01238
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: KH11500
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: LY17744
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY17744%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.nl] INFO: Scrape type for LY17744: 0
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: DF70778
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: SE53451
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE53451%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.nl] INFO: Scrape type for SE53451: 0
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: SV08873
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: XF31929
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: GU59213
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: VR53235
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR53235%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.nl] INFO: Scrape type for VR53235: 0
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: KY22626
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: KC57622
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: NJ54414
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: ZH86542
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.nl] INFO: Scrape type for RX96199: 0
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: DL70871
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: MA87282
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: UP76924
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: YB78167
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: PH19837
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH19837%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.nl] INFO: Scrape type for PH19837: 0
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: VW25358
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: PE66202
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: WB81216
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: ER66811
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: UY46153
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: XN23196
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XN23196%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.nl] INFO: Scrape type for XN23196: 0
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: NY67233
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY67233%27 HTTP/1.1" 200 None
2026-03-30 12:01:17 [auto1.nl] INFO: Scrape type for NY67233: 0
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: VL04005
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: GV35300
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: WX35760
2026-03-30 12:01:17 [auto1.nl] INFO: Found listing with ID: DR68176
2026-03-30 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL04005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB78167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR68176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC57622> (referer: https://www.auto1.com/v1/car-details-view/KC57622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89297705-333d-56a0-ad09-8bf4617fd6a9 with identifier: KC57622
2026-03-30 12:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89297705-333d-56a0-ad09-8bf4617fd6a9 with scrape type 1
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_4d2b39416d729ea37f586f57f6747a03.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_4d2b39416d729ea37f586f57f6747a03.jpg not downloaded yet
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_b589cd50293a84f95ced50a6ce1cd5b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_b589cd50293a84f95ced50a6ce1cd5b2.jpg not downloaded yet
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_4442c12cb6e505f4b25fc086259af9b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_4442c12cb6e505f4b25fc086259af9b9.jpg not downloaded yet
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_6517adc8736b1a45099d202f74e612bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_6517adc8736b1a45099d202f74e612bb.jpg not downloaded yet
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_10f5c2ff096b17de198484e4b85894f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_10f5c2ff096b17de198484e4b85894f0.jpg not downloaded yet
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_f9ef97e63bc9e5f94af2600291b36574.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_f9ef97e63bc9e5f94af2600291b36574.jpg not downloaded yet
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_09ef50f867feeeecbcc6b08743f9652f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_09ef50f867feeeecbcc6b08743f9652f.jpg not downloaded yet
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_3c15a38f0ee2768b60c31dc357bbff27.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_3c15a38f0ee2768b60c31dc357bbff27.jpg not downloaded yet
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_3ca500815d908fbb4d71f54decfc2464.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_3ca500815d908fbb4d71f54decfc2464.jpg not downloaded yet
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_8f63ac1d923958248cb48959d2e5e6c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_8f63ac1d923958248cb48959d2e5e6c2.jpg not downloaded yet
2026-03-30 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY46153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_8f63ac1d923958248cb48959d2e5e6c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 12:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f751450>
2026-03-30 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 12:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_8f63ac1d923958248cb48959d2e5e6c2.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_8f63ac1d923958248cb48959d2e5e6c2.jpg saved to cache
2026-03-30 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF70778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_3ca500815d908fbb4d71f54decfc2464.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f75ff10>
2026-03-30 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_3ca500815d908fbb4d71f54decfc2464.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_3ca500815d908fbb4d71f54decfc2464.jpg saved to cache
2026-03-30 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER66811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_3c15a38f0ee2768b60c31dc357bbff27.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f778350>
2026-03-30 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_3c15a38f0ee2768b60c31dc357bbff27.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_3c15a38f0ee2768b60c31dc357bbff27.jpg saved to cache
2026-03-30 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU59213> (referer: https://www.auto1.com/v1/car-details-view/GU59213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c501bf3-eced-53e1-9a17-c33e81f71aa7 with identifier: GU59213
2026-03-30 12:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7 with scrape type 1
2026-03-30 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_e7e7d6edaab93a1fbd0dc93165a1761c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_e7e7d6edaab93a1fbd0dc93165a1761c.jpg not downloaded yet
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_46f10801052e103b1c786982a02bf039.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_46f10801052e103b1c786982a02bf039.jpg not downloaded yet
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_9f23cdf98bc39345899bc2170de1e3ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_9f23cdf98bc39345899bc2170de1e3ea.jpg not downloaded yet
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_2779525b7dbb62a67e71fc0658e9e94b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_2779525b7dbb62a67e71fc0658e9e94b.jpg not downloaded yet
2026-03-30 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_09ef50f867feeeecbcc6b08743f9652f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_7d8c4ec948e43ca5f225bcdcb46d984a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_7d8c4ec948e43ca5f225bcdcb46d984a.jpg not downloaded yet
2026-03-30 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_069c268f0d9109b3a8558bec9f8443c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_069c268f0d9109b3a8558bec9f8443c9.jpg not downloaded yet
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_1546ae8e17a737946fe579ff5a3f85d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_1546ae8e17a737946fe579ff5a3f85d6.jpg not downloaded yet
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_9d7de974ad1ddbacbbaf008ad8e9f4ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_9d7de974ad1ddbacbbaf008ad8e9f4ee.jpg not downloaded yet
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_e43b084f50c5a5cf9a056814f809821d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_e43b084f50c5a5cf9a056814f809821d.jpg not downloaded yet
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_51ce78194ff9f59d0674332ccfc250c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_51ce78194ff9f59d0674332ccfc250c1.jpg not downloaded yet
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74099790>
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_09ef50f867feeeecbcc6b08743f9652f.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_09ef50f867feeeecbcc6b08743f9652f.jpg saved to cache
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_2779525b7dbb62a67e71fc0658e9e94b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee51ed0>
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_2779525b7dbb62a67e71fc0658e9e94b.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_2779525b7dbb62a67e71fc0658e9e94b.jpg saved to cache
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_51ce78194ff9f59d0674332ccfc250c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a7950>
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_51ce78194ff9f59d0674332ccfc250c1.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_51ce78194ff9f59d0674332ccfc250c1.jpg saved to cache
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_e43b084f50c5a5cf9a056814f809821d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee52450>
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_e43b084f50c5a5cf9a056814f809821d.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_e43b084f50c5a5cf9a056814f809821d.jpg saved to cache
2026-03-30 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_9d7de974ad1ddbacbbaf008ad8e9f4ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740e13d0>
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_9d7de974ad1ddbacbbaf008ad8e9f4ee.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_9d7de974ad1ddbacbbaf008ad8e9f4ee.jpg saved to cache
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_1546ae8e17a737946fe579ff5a3f85d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee06750>
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_1546ae8e17a737946fe579ff5a3f85d6.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_1546ae8e17a737946fe579ff5a3f85d6.jpg saved to cache
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_069c268f0d9109b3a8558bec9f8443c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee23b50>
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_069c268f0d9109b3a8558bec9f8443c9.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_069c268f0d9109b3a8558bec9f8443c9.jpg saved to cache
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_7d8c4ec948e43ca5f225bcdcb46d984a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee53190>
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_7d8c4ec948e43ca5f225bcdcb46d984a.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_7d8c4ec948e43ca5f225bcdcb46d984a.jpg saved to cache
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_9f23cdf98bc39345899bc2170de1e3ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74083ed0>
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_9f23cdf98bc39345899bc2170de1e3ea.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_9f23cdf98bc39345899bc2170de1e3ea.jpg saved to cache
2026-03-30 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_46f10801052e103b1c786982a02bf039.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_e7e7d6edaab93a1fbd0dc93165a1761c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7454d010>
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_46f10801052e103b1c786982a02bf039.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_46f10801052e103b1c786982a02bf039.jpg saved to cache
2026-03-30 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee50a90>
2026-03-30 12:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F04%252Fa804a476e3b016c0819bda4b5e6d51e5%252Fpa%252FGU59213_e7e7d6edaab93a1fbd0dc93165a1761c.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_e7e7d6edaab93a1fbd0dc93165a1761c.jpg saved to cache
2026-03-30 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7
2026-03-30 12:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c501bf3-eced-53e1-9a17-c33e81f71aa7, skipping ID generation
2026-03-30 12:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7 with scrape type 1
2026-03-30 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c501bf3-eced-53e1-9a17-c33e81f71aa7 sending to next pipeline
2026-03-30 12:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4c501bf3-eced-53e1-9a17-c33e81f71aa7, identifier: GU59213
2026-03-30 12:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4c501bf3-eced-53e1-9a17-c33e81f71aa7 with identifier: GU59213
2026-03-30 12:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4c501bf3-eced-53e1-9a17-c33e81f71aa7 with identifier: GU59213
2026-03-30 12:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4c501bf3-eced-53e1-9a17-c33e81f71aa7 with identifier: GU59213 to the API
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_e7e7d6edaab93a1fbd0dc93165a1761c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:57:52Z',
 'fuel_type': 'petrol',
 'id': '4c501bf3-eced-53e1-9a17-c33e81f71aa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7-KDL-32',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU59213',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 265214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_e7e7d6edaab93a1fbd0dc93165a1761c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_46f10801052e103b1c786982a02bf039.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_9f23cdf98bc39345899bc2170de1e3ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_2779525b7dbb62a67e71fc0658e9e94b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_7d8c4ec948e43ca5f225bcdcb46d984a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_069c268f0d9109b3a8558bec9f8443c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_1546ae8e17a737946fe579ff5a3f85d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_9d7de974ad1ddbacbbaf008ad8e9f4ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_e43b084f50c5a5cf9a056814f809821d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c501bf3-eced-53e1-9a17-c33e81f71aa7/4c501bf3-eced-53e1-9a17-c33e81f71aa7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/04/a804a476e3b016c0819bda4b5e6d51e5/pa/GU59213_51ce78194ff9f59d0674332ccfc250c1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU59213%27 HTTP/1.1" 200 None
2026-03-30 12:01:57 [auto1.nl] INFO: Saving data for GU59213: {'created_time': 1774872117.741793, 'last_price_update_time': 1774872117.741805, 'auction_closing_time': 1774972672.0}
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GU59213') HTTP/1.1" 204 0
2026-03-30 12:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_f9ef97e63bc9e5f94af2600291b36574.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee20890>
2026-03-30 12:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_f9ef97e63bc9e5f94af2600291b36574.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_f9ef97e63bc9e5f94af2600291b36574.jpg saved to cache
2026-03-30 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_10f5c2ff096b17de198484e4b85894f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_6517adc8736b1a45099d202f74e612bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74543410>
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_10f5c2ff096b17de198484e4b85894f0.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_10f5c2ff096b17de198484e4b85894f0.jpg saved to cache
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f75db10>
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_6517adc8736b1a45099d202f74e612bb.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_6517adc8736b1a45099d202f74e612bb.jpg saved to cache
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_4442c12cb6e505f4b25fc086259af9b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee21a90>
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_4442c12cb6e505f4b25fc086259af9b9.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_4442c12cb6e505f4b25fc086259af9b9.jpg saved to cache
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_b589cd50293a84f95ced50a6ce1cd5b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_4d2b39416d729ea37f586f57f6747a03.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee21510>
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_b589cd50293a84f95ced50a6ce1cd5b2.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_b589cd50293a84f95ced50a6ce1cd5b2.jpg saved to cache
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f700cd0>
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F5d%252F4d5dd80833e8d743d3e9969f1aa3670a%252Fpa%252FKC57622_4d2b39416d729ea37f586f57f6747a03.jpg') HTTP/1.1" 204 0
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_4d2b39416d729ea37f586f57f6747a03.jpg saved to cache
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89297705-333d-56a0-ad09-8bf4617fd6a9
2026-03-30 12:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89297705-333d-56a0-ad09-8bf4617fd6a9, skipping ID generation
2026-03-30 12:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89297705-333d-56a0-ad09-8bf4617fd6a9 with scrape type 1
2026-03-30 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89297705-333d-56a0-ad09-8bf4617fd6a9 sending to next pipeline
2026-03-30 12:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 89297705-333d-56a0-ad09-8bf4617fd6a9, identifier: KC57622
2026-03-30 12:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 89297705-333d-56a0-ad09-8bf4617fd6a9 with identifier: KC57622
2026-03-30 12:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 89297705-333d-56a0-ad09-8bf4617fd6a9 with identifier: KC57622
2026-03-30 12:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 89297705-333d-56a0-ad09-8bf4617fd6a9 with identifier: KC57622 to the API
2026-03-30 12:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_4d2b39416d729ea37f586f57f6747a03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:49:14Z',
 'fuel_type': 'petrol',
 'id': '89297705-333d-56a0-ad09-8bf4617fd6a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '6TZJ68',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC57622',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 155441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_4d2b39416d729ea37f586f57f6747a03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_b589cd50293a84f95ced50a6ce1cd5b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_4442c12cb6e505f4b25fc086259af9b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_6517adc8736b1a45099d202f74e612bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_10f5c2ff096b17de198484e4b85894f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_f9ef97e63bc9e5f94af2600291b36574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_09ef50f867feeeecbcc6b08743f9652f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_3c15a38f0ee2768b60c31dc357bbff27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_3ca500815d908fbb4d71f54decfc2464.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89297705-333d-56a0-ad09-8bf4617fd6a9/89297705-333d-56a0-ad09-8bf4617fd6a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/5d/4d5dd80833e8d743d3e9969f1aa3670a/pa/KC57622_8f63ac1d923958248cb48959d2e5e6c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC57622%27 HTTP/1.1" 200 None
2026-03-30 12:01:59 [auto1.nl] INFO: Saving data for KC57622: {'created_time': 1774872119.26094, 'last_price_update_time': 1774872119.26095, 'auction_closing_time': 1774972154.0}
2026-03-30 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC57622') HTTP/1.1" 204 0
2026-03-30 12:02:07 [scrapy.extensions.logstats] INFO: Crawled 19 pages (at 13 pages/min), scraped 11 items (at 2 items/min)
2026-03-30 12:02:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE66202> (referer: https://www.auto1.com/v1/car-details-view/PE66202/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70179efd-19f2-53da-89d5-17e74d651d9f with identifier: PE66202
2026-03-30 12:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70179efd-19f2-53da-89d5-17e74d651d9f with scrape type 1
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_019071611c47f75ec62f578749281f70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_019071611c47f75ec62f578749281f70.jpg not downloaded yet
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_76d413620123c50b7d2cbf674f369cd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_76d413620123c50b7d2cbf674f369cd1.jpg not downloaded yet
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_f4df862d09d8f16403d928b3285aa77a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_f4df862d09d8f16403d928b3285aa77a.jpg not downloaded yet
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_7614e5210758ac7583f1d4aa21c615f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_7614e5210758ac7583f1d4aa21c615f9.jpg not downloaded yet
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_0ee0225c9f17fba0170a3187b4ed0343.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_0ee0225c9f17fba0170a3187b4ed0343.jpg not downloaded yet
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_1e57700901369101dbbc05c8c49fe5f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_1e57700901369101dbbc05c8c49fe5f6.jpg not downloaded yet
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_e003eec4aa73641cbbb4baf9fc90e44a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_e003eec4aa73641cbbb4baf9fc90e44a.jpg not downloaded yet
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_b6e18a9bfa7e4b58462eb4f697a46fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_b6e18a9bfa7e4b58462eb4f697a46fc7.jpg not downloaded yet
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_a0975191bf3e42f4d887e5b3e411784a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_a0975191bf3e42f4d887e5b3e411784a.jpg not downloaded yet
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_e7968547e7e4d47b0bab558db15a1cdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_e7968547e7e4d47b0bab558db15a1cdf.jpg not downloaded yet
2026-03-30 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_019071611c47f75ec62f578749281f70.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75acd7d0>
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_019071611c47f75ec62f578749281f70.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_019071611c47f75ec62f578749281f70.jpg saved to cache
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_76d413620123c50b7d2cbf674f369cd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_e7968547e7e4d47b0bab558db15a1cdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a3010>
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_76d413620123c50b7d2cbf674f369cd1.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_76d413620123c50b7d2cbf674f369cd1.jpg saved to cache
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_b6e18a9bfa7e4b58462eb4f697a46fc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75650750>
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_e7968547e7e4d47b0bab558db15a1cdf.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_e7968547e7e4d47b0bab558db15a1cdf.jpg saved to cache
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_a0975191bf3e42f4d887e5b3e411784a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740da890>
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_b6e18a9bfa7e4b58462eb4f697a46fc7.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_b6e18a9bfa7e4b58462eb4f697a46fc7.jpg saved to cache
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a2b10>
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_a0975191bf3e42f4d887e5b3e411784a.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_a0975191bf3e42f4d887e5b3e411784a.jpg saved to cache
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_1e57700901369101dbbc05c8c49fe5f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_e003eec4aa73641cbbb4baf9fc90e44a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f778350>
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_1e57700901369101dbbc05c8c49fe5f6.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_1e57700901369101dbbc05c8c49fe5f6.jpg saved to cache
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_7614e5210758ac7583f1d4aa21c615f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB81216> (referer: https://www.auto1.com/v1/car-details-view/WB81216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7406ce90>
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_e003eec4aa73641cbbb4baf9fc90e44a.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_e003eec4aa73641cbbb4baf9fc90e44a.jpg saved to cache
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_0ee0225c9f17fba0170a3187b4ed0343.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f76ee10>
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_7614e5210758ac7583f1d4aa21c615f9.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_7614e5210758ac7583f1d4aa21c615f9.jpg saved to cache
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94af0bb4-e2ee-5636-aca7-835c66c4ec10 with identifier: WB81216
2026-03-30 12:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94af0bb4-e2ee-5636-aca7-835c66c4ec10 with scrape type 1
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 94af0bb4-e2ee-5636-aca7-835c66c4ec10
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_38eff0cba7910b30aef56915607676e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_38eff0cba7910b30aef56915607676e4.jpg not downloaded yet
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_0c22aae0e2e4770d65ce86c25ebae234.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_0c22aae0e2e4770d65ce86c25ebae234.jpg not downloaded yet
2026-03-30 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_f4df862d09d8f16403d928b3285aa77a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_22abdbc3b4ab966af1ae27bfbe1f6a76.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_22abdbc3b4ab966af1ae27bfbe1f6a76.jpg not downloaded yet
2026-03-30 12:02:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74068e10>
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_0ee0225c9f17fba0170a3187b4ed0343.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_0ee0225c9f17fba0170a3187b4ed0343.jpg saved to cache
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_472dd87837badfca6d205af8714fc798.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_472dd87837badfca6d205af8714fc798.jpg not downloaded yet
2026-03-30 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_38eff0cba7910b30aef56915607676e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_5a7a1a851f0ced6f8081a042b38efe48.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_5a7a1a851f0ced6f8081a042b38efe48.jpg not downloaded yet
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f75d5d0>
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fca%252F1eca1b72d922265a9a8459988b6d2abf%252Fpa%252FPE66202_f4df862d09d8f16403d928b3285aa77a.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_f4df862d09d8f16403d928b3285aa77a.jpg saved to cache
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70179efd-19f2-53da-89d5-17e74d651d9f
2026-03-30 12:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70179efd-19f2-53da-89d5-17e74d651d9f, skipping ID generation
2026-03-30 12:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70179efd-19f2-53da-89d5-17e74d651d9f with scrape type 1
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70179efd-19f2-53da-89d5-17e74d651d9f sending to next pipeline
2026-03-30 12:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 70179efd-19f2-53da-89d5-17e74d651d9f, identifier: PE66202
2026-03-30 12:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 70179efd-19f2-53da-89d5-17e74d651d9f with identifier: PE66202
2026-03-30 12:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 70179efd-19f2-53da-89d5-17e74d651d9f with identifier: PE66202
2026-03-30 12:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 70179efd-19f2-53da-89d5-17e74d651d9f with identifier: PE66202 to the API
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_f4df862d09d8f16403d928b3285aa77a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:06:19Z',
 'fuel_type': 'petrol',
 'id': '70179efd-19f2-53da-89d5-17e74d651d9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'H806DK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE66202',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 171620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_019071611c47f75ec62f578749281f70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2126554,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_76d413620123c50b7d2cbf674f369cd1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_f4df862d09d8f16403d928b3285aa77a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_7614e5210758ac7583f1d4aa21c615f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2238749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_0ee0225c9f17fba0170a3187b4ed0343.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2309949,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_1e57700901369101dbbc05c8c49fe5f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_e003eec4aa73641cbbb4baf9fc90e44a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_b6e18a9bfa7e4b58462eb4f697a46fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2169602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_a0975191bf3e42f4d887e5b3e411784a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70179efd-19f2-53da-89d5-17e74d651d9f/70179efd-19f2-53da-89d5-17e74d651d9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/ca/1eca1b72d922265a9a8459988b6d2abf/pa/PE66202_e7968547e7e4d47b0bab558db15a1cdf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE66202%27 HTTP/1.1" 200 None
2026-03-30 12:02:15 [auto1.nl] INFO: Saving data for PE66202: {'created_time': 1774872135.201323, 'last_price_update_time': 1774872135.201334, 'auction_closing_time': 1774969579.0}
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PE66202') HTTP/1.1" 204 0
2026-03-30 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_0c22aae0e2e4770d65ce86c25ebae234.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee50210>
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_38eff0cba7910b30aef56915607676e4.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_38eff0cba7910b30aef56915607676e4.jpg saved to cache
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94af0bb4-e2ee-5636-aca7-835c66c4ec10
2026-03-30 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_472dd87837badfca6d205af8714fc798.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee7d990>
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_0c22aae0e2e4770d65ce86c25ebae234.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_0c22aae0e2e4770d65ce86c25ebae234.jpg saved to cache
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94af0bb4-e2ee-5636-aca7-835c66c4ec10
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f74db50>
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_472dd87837badfca6d205af8714fc798.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_472dd87837badfca6d205af8714fc798.jpg saved to cache
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94af0bb4-e2ee-5636-aca7-835c66c4ec10
2026-03-30 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_22abdbc3b4ab966af1ae27bfbe1f6a76.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_5a7a1a851f0ced6f8081a042b38efe48.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee8b010>
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_22abdbc3b4ab966af1ae27bfbe1f6a76.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_22abdbc3b4ab966af1ae27bfbe1f6a76.jpg saved to cache
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94af0bb4-e2ee-5636-aca7-835c66c4ec10
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee57b90>
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fad%252F31ad566eb17fc0f09eb5beb458189ddb%252Fpa%252FWB81216_5a7a1a851f0ced6f8081a042b38efe48.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_5a7a1a851f0ced6f8081a042b38efe48.jpg saved to cache
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94af0bb4-e2ee-5636-aca7-835c66c4ec10
2026-03-30 12:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94af0bb4-e2ee-5636-aca7-835c66c4ec10, skipping ID generation
2026-03-30 12:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94af0bb4-e2ee-5636-aca7-835c66c4ec10 with scrape type 1
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94af0bb4-e2ee-5636-aca7-835c66c4ec10 sending to next pipeline
2026-03-30 12:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 94af0bb4-e2ee-5636-aca7-835c66c4ec10, identifier: WB81216
2026-03-30 12:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 94af0bb4-e2ee-5636-aca7-835c66c4ec10 with identifier: WB81216
2026-03-30 12:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 94af0bb4-e2ee-5636-aca7-835c66c4ec10 with identifier: WB81216
2026-03-30 12:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 94af0bb4-e2ee-5636-aca7-835c66c4ec10 with identifier: WB81216 to the API
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_5a7a1a851f0ced6f8081a042b38efe48.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:53:27Z',
 'fuel_type': 'petrol',
 'id': '94af0bb4-e2ee-5636-aca7-835c66c4ec10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '3TSF90',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB81216',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 140829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_38eff0cba7910b30aef56915607676e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_0c22aae0e2e4770d65ce86c25ebae234.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_22abdbc3b4ab966af1ae27bfbe1f6a76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_472dd87837badfca6d205af8714fc798.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94af0bb4-e2ee-5636-aca7-835c66c4ec10/94af0bb4-e2ee-5636-aca7-835c66c4ec10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/ad/31ad566eb17fc0f09eb5beb458189ddb/pa/WB81216_5a7a1a851f0ced6f8081a042b38efe48.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WB81216%27 HTTP/1.1" 200 None
2026-03-30 12:02:16 [auto1.nl] INFO: Saving data for WB81216: {'created_time': 1774872136.319576, 'last_price_update_time': 1774872136.319586, 'auction_closing_time': 1774972407.0}
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WB81216') HTTP/1.1" 204 0
2026-03-30 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL04005> (referer: https://www.auto1.com/v1/car-details-view/VL04005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7888591c-59f2-5b41-8e3d-efb67a6dd449 with identifier: VL04005
2026-03-30 12:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7888591c-59f2-5b41-8e3d-efb67a6dd449 with scrape type 1
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_1251ea69906325ec7d8b0960b946a9a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_1251ea69906325ec7d8b0960b946a9a4.jpg not downloaded yet
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_8c21b058d314ca42bbfeae771b1decd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_8c21b058d314ca42bbfeae771b1decd9.jpg not downloaded yet
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_75213c83f126c7cedc5e860a99822184.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_75213c83f126c7cedc5e860a99822184.jpg not downloaded yet
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_880c2bf8740de3bfe481260575b0e193.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_880c2bf8740de3bfe481260575b0e193.jpg not downloaded yet
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_4d3c4cfa7578bba95c41a27bb7f92264.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_4d3c4cfa7578bba95c41a27bb7f92264.jpg not downloaded yet
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_753b81dcb060ad5a6d1a7e913feb40b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_753b81dcb060ad5a6d1a7e913feb40b2.jpg not downloaded yet
2026-03-30 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_1251ea69906325ec7d8b0960b946a9a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_8c21b058d314ca42bbfeae771b1decd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_8182a7d70ce90663dc20e22e5a469a42.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_8182a7d70ce90663dc20e22e5a469a42.jpg not downloaded yet
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_6a002ed7b7edab257d5b7bc81b7792b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_6a002ed7b7edab257d5b7bc81b7792b6.jpg not downloaded yet
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_3a47f53f6a90231b768b0f11088dc809.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_3a47f53f6a90231b768b0f11088dc809.jpg not downloaded yet
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_cc45295c9f81333fd1421e0d9272e31d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_cc45295c9f81333fd1421e0d9272e31d.jpg not downloaded yet
2026-03-30 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee89f90>
2026-03-30 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_1251ea69906325ec7d8b0960b946a9a4.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_1251ea69906325ec7d8b0960b946a9a4.jpg saved to cache
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74135cd0>
2026-03-30 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_8c21b058d314ca42bbfeae771b1decd9.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_8c21b058d314ca42bbfeae771b1decd9.jpg saved to cache
2026-03-30 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_753b81dcb060ad5a6d1a7e913feb40b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_75213c83f126c7cedc5e860a99822184.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_4d3c4cfa7578bba95c41a27bb7f92264.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_cc45295c9f81333fd1421e0d9272e31d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee5ab90>
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_753b81dcb060ad5a6d1a7e913feb40b2.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_753b81dcb060ad5a6d1a7e913feb40b2.jpg saved to cache
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740d8910>
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_75213c83f126c7cedc5e860a99822184.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_75213c83f126c7cedc5e860a99822184.jpg saved to cache
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_6a002ed7b7edab257d5b7bc81b7792b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_880c2bf8740de3bfe481260575b0e193.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_3a47f53f6a90231b768b0f11088dc809.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a0c90>
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_4d3c4cfa7578bba95c41a27bb7f92264.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_4d3c4cfa7578bba95c41a27bb7f92264.jpg saved to cache
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee35a90>
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_cc45295c9f81333fd1421e0d9272e31d.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_cc45295c9f81333fd1421e0d9272e31d.jpg saved to cache
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_8182a7d70ce90663dc20e22e5a469a42.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74099f50>
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_6a002ed7b7edab257d5b7bc81b7792b6.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_6a002ed7b7edab257d5b7bc81b7792b6.jpg saved to cache
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee7ff90>
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_880c2bf8740de3bfe481260575b0e193.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_880c2bf8740de3bfe481260575b0e193.jpg saved to cache
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74045090>
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_3a47f53f6a90231b768b0f11088dc809.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_3a47f53f6a90231b768b0f11088dc809.jpg saved to cache
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb3450>
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1c%252F8d1cba7ba4228b3230bca189120a61f9%252Fpa%252FVL04005_8182a7d70ce90663dc20e22e5a469a42.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_8182a7d70ce90663dc20e22e5a469a42.jpg saved to cache
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7888591c-59f2-5b41-8e3d-efb67a6dd449
2026-03-30 12:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7888591c-59f2-5b41-8e3d-efb67a6dd449, skipping ID generation
2026-03-30 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7888591c-59f2-5b41-8e3d-efb67a6dd449 with scrape type 1
2026-03-30 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7888591c-59f2-5b41-8e3d-efb67a6dd449 sending to next pipeline
2026-03-30 12:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7888591c-59f2-5b41-8e3d-efb67a6dd449, identifier: VL04005
2026-03-30 12:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7888591c-59f2-5b41-8e3d-efb67a6dd449 with identifier: VL04005
2026-03-30 12:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7888591c-59f2-5b41-8e3d-efb67a6dd449 with identifier: VL04005
2026-03-30 12:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7888591c-59f2-5b41-8e3d-efb67a6dd449 with identifier: VL04005 to the API
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_8182a7d70ce90663dc20e22e5a469a42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:30:44Z',
 'fuel_type': 'petrol',
 'id': '7888591c-59f2-5b41-8e3d-efb67a6dd449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '1SXR07',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL04005',
 'listing': 'auction',
 'location': 'NL, Amstelveen',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 207771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_1251ea69906325ec7d8b0960b946a9a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_8c21b058d314ca42bbfeae771b1decd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_75213c83f126c7cedc5e860a99822184.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_880c2bf8740de3bfe481260575b0e193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_4d3c4cfa7578bba95c41a27bb7f92264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_753b81dcb060ad5a6d1a7e913feb40b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_8182a7d70ce90663dc20e22e5a469a42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_6a002ed7b7edab257d5b7bc81b7792b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_3a47f53f6a90231b768b0f11088dc809.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7888591c-59f2-5b41-8e3d-efb67a6dd449/7888591c-59f2-5b41-8e3d-efb67a6dd449_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1c/8d1cba7ba4228b3230bca189120a61f9/pa/VL04005_cc45295c9f81333fd1421e0d9272e31d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL04005%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [auto1.nl] INFO: Saving data for VL04005: {'created_time': 1774872140.024818, 'last_price_update_time': 1774872140.02488, 'auction_closing_time': 1774971044.0}
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL04005') HTTP/1.1" 204 0
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB78167> (referer: https://www.auto1.com/v1/car-details-view/YB78167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16d12ab9-5abd-5b98-84c9-808f73d04b4b with identifier: YB78167
2026-03-30 12:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b with scrape type 1
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_4d6c9f08babeca5ebdcb7f5fe318e705.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_4d6c9f08babeca5ebdcb7f5fe318e705.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_d8d25a8830044f90b4e51adb382f2954.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_d8d25a8830044f90b4e51adb382f2954.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_b02d230849280c1fc2ad135d55c83cbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_b02d230849280c1fc2ad135d55c83cbe.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_403fb6f583aca3c48105e6e7bb649ea9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_403fb6f583aca3c48105e6e7bb649ea9.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_07b72e8c5b93bc032c9bd1569630ee40.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_07b72e8c5b93bc032c9bd1569630ee40.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_005846219bb44b4263db6bb03c34f878.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_005846219bb44b4263db6bb03c34f878.jpg not downloaded yet
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_d8d25a8830044f90b4e51adb382f2954.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_4d6c9f08babeca5ebdcb7f5fe318e705.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_005846219bb44b4263db6bb03c34f878.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_b02d230849280c1fc2ad135d55c83cbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_403fb6f583aca3c48105e6e7bb649ea9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f79b650>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_d8d25a8830044f90b4e51adb382f2954.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_d8d25a8830044f90b4e51adb382f2954.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f76f050>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_4d6c9f08babeca5ebdcb7f5fe318e705.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_4d6c9f08babeca5ebdcb7f5fe318e705.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7454c310>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_005846219bb44b4263db6bb03c34f878.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_005846219bb44b4263db6bb03c34f878.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb47d0>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_b02d230849280c1fc2ad135d55c83cbe.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_b02d230849280c1fc2ad135d55c83cbe.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee91e90>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_403fb6f583aca3c48105e6e7bb649ea9.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_403fb6f583aca3c48105e6e7bb649ea9.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_07b72e8c5b93bc032c9bd1569630ee40.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740e0c90>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc9763b26b2c8ed7290ad72cbdf9702b0%252Fpa%252FYB78167_07b72e8c5b93bc032c9bd1569630ee40.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_07b72e8c5b93bc032c9bd1569630ee40.jpg saved to cache
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b
2026-03-30 12:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16d12ab9-5abd-5b98-84c9-808f73d04b4b, skipping ID generation
2026-03-30 12:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b with scrape type 1
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16d12ab9-5abd-5b98-84c9-808f73d04b4b sending to next pipeline
2026-03-30 12:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 16d12ab9-5abd-5b98-84c9-808f73d04b4b, identifier: YB78167
2026-03-30 12:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 16d12ab9-5abd-5b98-84c9-808f73d04b4b with identifier: YB78167
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 12:02:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 16d12ab9-5abd-5b98-84c9-808f73d04b4b with identifier: YB78167
2026-03-30 12:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 16d12ab9-5abd-5b98-84c9-808f73d04b4b with identifier: YB78167 to the API
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_07b72e8c5b93bc032c9bd1569630ee40.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 231,
 'expiration_date': '2026-03-31T15:11:38Z',
 'fuel_type': 'electro',
 'id': '16d12ab9-5abd-5b98-84c9-808f73d04b4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB78167',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 95472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431605,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_4d6c9f08babeca5ebdcb7f5fe318e705.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_d8d25a8830044f90b4e51adb382f2954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_b02d230849280c1fc2ad135d55c83cbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377179,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_403fb6f583aca3c48105e6e7bb649ea9.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_07b72e8c5b93bc032c9bd1569630ee40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16d12ab9-5abd-5b98-84c9-808f73d04b4b/16d12ab9-5abd-5b98-84c9-808f73d04b4b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c9763b26b2c8ed7290ad72cbdf9702b0/pa/YB78167_005846219bb44b4263db6bb03c34f878.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 Recharge 170 kW Ultimate 2WD',
 'transmission': 'automatic',
 'trim': 'Ultimate 2WD',
 'year': 2023}
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB78167%27 HTTP/1.1" 200 None
2026-03-30 12:02:21 [auto1.nl] INFO: Saving data for YB78167: {'created_time': 1774872141.792016, 'last_price_update_time': 1774872141.792028, 'auction_closing_time': 1774969898.0}
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB78167') HTTP/1.1" 204 0
2026-03-30 12:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA26437> (referer: https://www.auto1.com/v1/car-details-view/UA26437/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH11500> (referer: https://www.auto1.com/v1/car-details-view/KH11500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75863ca0-d842-5b08-a391-11a794d81a3f with identifier: UA26437
2026-03-30 12:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75863ca0-d842-5b08-a391-11a794d81a3f with scrape type 1
2026-03-30 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_6799fd1adabbdaef6f86307d4447c2b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_6799fd1adabbdaef6f86307d4447c2b1.jpg not downloaded yet
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_184a027c8aaed74c553e7c5e2edc4519.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_184a027c8aaed74c553e7c5e2edc4519.jpg not downloaded yet
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_f8a70b264460fe63b84a14af78f10e60.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_f8a70b264460fe63b84a14af78f10e60.jpg not downloaded yet
2026-03-30 12:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e949699e-d516-561f-adbb-7a22c232e668 with identifier: KH11500
2026-03-30 12:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e949699e-d516-561f-adbb-7a22c232e668 with scrape type 1
2026-03-30 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e949699e-d516-561f-adbb-7a22c232e668
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_db4236c7bd8fbcdea5c75aa656ddeb44.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_db4236c7bd8fbcdea5c75aa656ddeb44.jpg already downloaded
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_35024df5d7e5583225fe3ece53eac62a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_35024df5d7e5583225fe3ece53eac62a.jpg already downloaded
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_fb90e9483580b605dd0b57d7d84c51bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_fb90e9483580b605dd0b57d7d84c51bb.jpg already downloaded
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_dc78338bedecddb689acbf59ddfb8e33.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_dc78338bedecddb689acbf59ddfb8e33.jpg already downloaded
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_224e7f7a5c0793c6cfd0275e71c39aee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_224e7f7a5c0793c6cfd0275e71c39aee.jpg already downloaded
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_10bf4f81033480861e6bc39aed810e7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_10bf4f81033480861e6bc39aed810e7f.jpg already downloaded
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_a9f00c378775f1572bb4567d8a7fbca2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_a9f00c378775f1572bb4567d8a7fbca2.jpg already downloaded
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_5777974484fa1f89c880138733d52e41.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_5777974484fa1f89c880138733d52e41.jpg already downloaded
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_674bf1137bf3fb9350c6b6bd3b1823c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_674bf1137bf3fb9350c6b6bd3b1823c0.jpg already downloaded
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Fc5%252F51c565c10b65687613b831c5ec5194cf%252Fpa%252FKH11500_efb4a2708ec0d2607be3afadc1235a21.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_efb4a2708ec0d2607be3afadc1235a21.jpg already downloaded
2026-03-30 12:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e949699e-d516-561f-adbb-7a22c232e668, identifier: KH11500
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_9867c0d0d3902e03b9d79709237c5c43.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_9867c0d0d3902e03b9d79709237c5c43.jpg not downloaded yet
2026-03-30 12:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e949699e-d516-561f-adbb-7a22c232e668 with identifier: KH11500
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e949699e-d516-561f-adbb-7a22c232e668 with identifier: KH11500
2026-03-30 12:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e949699e-d516-561f-adbb-7a22c232e668 with identifier: KH11500 to the API
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KH11500>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:03:46Z',
 'fuel_type': 'hybrid',
 'id': 'e949699e-d516-561f-adbb-7a22c232e668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KZ259Z',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH11500',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 220905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_db4236c7bd8fbcdea5c75aa656ddeb44.jpg',
                'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_35024df5d7e5583225fe3ece53eac62a.jpg',
                'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_fb90e9483580b605dd0b57d7d84c51bb.jpg',
                'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_dc78338bedecddb689acbf59ddfb8e33.jpg',
                'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_224e7f7a5c0793c6cfd0275e71c39aee.jpg',
                'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_10bf4f81033480861e6bc39aed810e7f.jpg',
                'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_a9f00c378775f1572bb4567d8a7fbca2.jpg',
                'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_5777974484fa1f89c880138733d52e41.jpg',
                'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_674bf1137bf3fb9350c6b6bd3b1823c0.jpg',
                'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_efb4a2708ec0d2607be3afadc1235a21.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_db4236c7bd8fbcdea5c75aa656ddeb44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_35024df5d7e5583225fe3ece53eac62a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_fb90e9483580b605dd0b57d7d84c51bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_dc78338bedecddb689acbf59ddfb8e33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_224e7f7a5c0793c6cfd0275e71c39aee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_10bf4f81033480861e6bc39aed810e7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_a9f00c378775f1572bb4567d8a7fbca2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_5777974484fa1f89c880138733d52e41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_674bf1137bf3fb9350c6b6bd3b1823c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e949699e-d516-561f-adbb-7a22c232e668/e949699e-d516-561f-adbb-7a22c232e668_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/c5/51c565c10b65687613b831c5ec5194cf/pa/KH11500_efb4a2708ec0d2607be3afadc1235a21.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH11500%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [auto1.nl] INFO: Saving data for KH11500: {'created_time': 1774872153.715186, 'last_price_update_time': 1774872153.715201, 'auction_closing_time': 1774969426.0}
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KH11500') HTTP/1.1" 204 0
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_6799fd1adabbdaef6f86307d4447c2b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_b49ec69d310c75a7175ada1468a50173.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_b49ec69d310c75a7175ada1468a50173.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_9f5a6a594c2cf2c279cffc01295a8b99.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_9f5a6a594c2cf2c279cffc01295a8b99.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_a563dda8bc751f3fed7edcd636784d70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_a563dda8bc751f3fed7edcd636784d70.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_f9bdcf73d72691ed63facafc89e8cac6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_f9bdcf73d72691ed63facafc89e8cac6.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_0e89ae834bb28a4aaf50551a4605b886.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_0e89ae834bb28a4aaf50551a4605b886.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_98a3c44d447ab4931e735923fd49a0b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_98a3c44d447ab4931e735923fd49a0b2.jpg not downloaded yet
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f78d590>
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_6799fd1adabbdaef6f86307d4447c2b1.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_6799fd1adabbdaef6f86307d4447c2b1.jpg saved to cache
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_9867c0d0d3902e03b9d79709237c5c43.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_f8a70b264460fe63b84a14af78f10e60.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_184a027c8aaed74c553e7c5e2edc4519.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_b49ec69d310c75a7175ada1468a50173.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a4e50>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_9867c0d0d3902e03b9d79709237c5c43.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_9867c0d0d3902e03b9d79709237c5c43.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eebbcd0>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_f8a70b264460fe63b84a14af78f10e60.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_f8a70b264460fe63b84a14af78f10e60.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_9f5a6a594c2cf2c279cffc01295a8b99.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7565dd90>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_184a027c8aaed74c553e7c5e2edc4519.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_184a027c8aaed74c553e7c5e2edc4519.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee7fed0>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_b49ec69d310c75a7175ada1468a50173.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_b49ec69d310c75a7175ada1468a50173.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_98a3c44d447ab4931e735923fd49a0b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_a563dda8bc751f3fed7edcd636784d70.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_0e89ae834bb28a4aaf50551a4605b886.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740da510>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_9f5a6a594c2cf2c279cffc01295a8b99.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_9f5a6a594c2cf2c279cffc01295a8b99.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_f9bdcf73d72691ed63facafc89e8cac6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74137950>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_98a3c44d447ab4931e735923fd49a0b2.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_98a3c44d447ab4931e735923fd49a0b2.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee59790>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_a563dda8bc751f3fed7edcd636784d70.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_a563dda8bc751f3fed7edcd636784d70.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f74fa10>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_0e89ae834bb28a4aaf50551a4605b886.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_0e89ae834bb28a4aaf50551a4605b886.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740724d0>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F34%252Fbf3465215ecc488c782887e211cba78e%252Fpa%252FUA26437_f9bdcf73d72691ed63facafc89e8cac6.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_f9bdcf73d72691ed63facafc89e8cac6.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75863ca0-d842-5b08-a391-11a794d81a3f
2026-03-30 12:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75863ca0-d842-5b08-a391-11a794d81a3f, skipping ID generation
2026-03-30 12:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75863ca0-d842-5b08-a391-11a794d81a3f with scrape type 1
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75863ca0-d842-5b08-a391-11a794d81a3f sending to next pipeline
2026-03-30 12:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 75863ca0-d842-5b08-a391-11a794d81a3f, identifier: UA26437
2026-03-30 12:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 75863ca0-d842-5b08-a391-11a794d81a3f with identifier: UA26437
2026-03-30 12:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 75863ca0-d842-5b08-a391-11a794d81a3f with identifier: UA26437
2026-03-30 12:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 75863ca0-d842-5b08-a391-11a794d81a3f with identifier: UA26437 to the API
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_f9bdcf73d72691ed63facafc89e8cac6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:51:06Z',
 'fuel_type': 'petrol',
 'id': '75863ca0-d842-5b08-a391-11a794d81a3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JV352X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA26437',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 84043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_6799fd1adabbdaef6f86307d4447c2b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_184a027c8aaed74c553e7c5e2edc4519.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_f8a70b264460fe63b84a14af78f10e60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_9867c0d0d3902e03b9d79709237c5c43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_b49ec69d310c75a7175ada1468a50173.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_9f5a6a594c2cf2c279cffc01295a8b99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_a563dda8bc751f3fed7edcd636784d70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_f9bdcf73d72691ed63facafc89e8cac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_0e89ae834bb28a4aaf50551a4605b886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75863ca0-d842-5b08-a391-11a794d81a3f/75863ca0-d842-5b08-a391-11a794d81a3f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/34/bf3465215ecc488c782887e211cba78e/pa/UA26437_98a3c44d447ab4931e735923fd49a0b2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.6 GDI Go!',
 'transmission': 'manual',
 'trim': 'Go!',
 'year': 2016}
2026-03-30 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA26437%27 HTTP/1.1" 200 None
2026-03-30 12:02:35 [auto1.nl] INFO: Saving data for UA26437: {'created_time': 1774872155.012463, 'last_price_update_time': 1774872155.012475, 'auction_closing_time': 1774972266.0}
2026-03-30 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UA26437') HTTP/1.1" 204 0
2026-03-30 12:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:46 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 1022 | hits on page: 40
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: DR68176
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: VA44599
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA44599%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [auto1.nl] INFO: Scrape type for VA44599: 1
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: LT18437
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: GG31477
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: KC94217
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: AL09883
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL09883%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [auto1.nl] INFO: Scrape type for AL09883: 1
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: KY41956
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: LG57032
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: EY89733
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY89733%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [auto1.nl] INFO: Scrape type for EY89733: 1
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: BZ50743
2026-03-30 12:02:46 [auto1.nl] INFO: Found listing with ID: VN23813
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN23813%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [auto1.nl] INFO: Scrape type for VN23813: 2
2026-03-30 12:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1b1461-6db7-59dd-bc7d-de307aaead2d with identifier: VN23813
2026-03-30 12:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1b1461-6db7-59dd-bc7d-de307aaead2d with scrape type 2
2026-03-30 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1b1461-6db7-59dd-bc7d-de307aaead2d with scrape type 2
2026-03-30 12:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5a1b1461-6db7-59dd-bc7d-de307aaead2d, identifier: VN23813
2026-03-30 12:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5a1b1461-6db7-59dd-bc7d-de307aaead2d with identifier: VN23813
2026-03-30 12:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5a1b1461-6db7-59dd-bc7d-de307aaead2d with identifier: VN23813
2026-03-30 12:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5a1b1461-6db7-59dd-bc7d-de307aaead2d with identifier: VN23813 to the API
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:33:34Z',
 'fuel_type': 'petrol',
 'id': '5a1b1461-6db7-59dd-bc7d-de307aaead2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN23813',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 144264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-14',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN23813%27 HTTP/1.1" 200 None
2026-03-30 12:02:46 [auto1.nl] INFO: Saving data for VN23813: {'auction_closing_time': 1774971214.0, 'created_time': 1773688506.570896, 'last_price_update_time': 1774872166.993133}
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VN23813') HTTP/1.1" 204 0
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: BJ30921
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ30921%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [auto1.nl] INFO: Scrape type for BJ30921: 1
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: NA44396
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA44396%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [auto1.nl] INFO: Scrape type for NA44396: 1
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: MV83370
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV83370%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [auto1.nl] INFO: Scrape type for MV83370: 2
2026-03-30 12:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c024e8ec-1f6c-5b24-8c3b-f7b01cf466e3 with identifier: MV83370
2026-03-30 12:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c024e8ec-1f6c-5b24-8c3b-f7b01cf466e3 with scrape type 2
2026-03-30 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c024e8ec-1f6c-5b24-8c3b-f7b01cf466e3 with scrape type 2
2026-03-30 12:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c024e8ec-1f6c-5b24-8c3b-f7b01cf466e3, identifier: MV83370
2026-03-30 12:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c024e8ec-1f6c-5b24-8c3b-f7b01cf466e3 with identifier: MV83370
2026-03-30 12:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c024e8ec-1f6c-5b24-8c3b-f7b01cf466e3 with identifier: MV83370
2026-03-30 12:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c024e8ec-1f6c-5b24-8c3b-f7b01cf466e3 with identifier: MV83370 to the API
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:25:47Z',
 'fuel_type': 'petrol',
 'id': 'c024e8ec-1f6c-5b24-8c3b-f7b01cf466e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV83370',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 203557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-19',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV83370%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [auto1.nl] INFO: Saving data for MV83370: {'auction_closing_time': 1774970747.0, 'created_time': 1773514926.714675, 'last_price_update_time': 1774872167.722681}
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MV83370') HTTP/1.1" 204 0
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: EB77736
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: KG57573
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG57573%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [auto1.nl] INFO: Scrape type for KG57573: 1
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: UN65044
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: BV79930
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV79930%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [auto1.nl] INFO: Scrape type for BV79930: 1
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: JK44728
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK44728%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [auto1.nl] INFO: Scrape type for JK44728: 1
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: NL07359
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL07359%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [auto1.nl] INFO: Scrape type for NL07359: 1
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: NC11102
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC11102%27 HTTP/1.1" 200 None
2026-03-30 12:02:47 [auto1.nl] INFO: Scrape type for NC11102: 1
2026-03-30 12:02:47 [auto1.nl] INFO: Found listing with ID: GZ47828
2026-03-30 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ47828%27 HTTP/1.1" 200 None
2026-03-30 12:02:48 [auto1.nl] INFO: Scrape type for GZ47828: 1
2026-03-30 12:02:48 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-30 12:02:48 [auto1.nl] INFO: Found listing with ID: KF66593
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF66593%27 HTTP/1.1" 200 None
2026-03-30 12:02:48 [auto1.nl] INFO: Scrape type for KF66593: 1
2026-03-30 12:02:48 [auto1.nl] INFO: Found listing with ID: XD28963
2026-03-30 12:02:48 [auto1.nl] INFO: Found listing with ID: FH41507
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH41507%27 HTTP/1.1" 200 None
2026-03-30 12:02:48 [auto1.nl] INFO: Scrape type for FH41507: 2
2026-03-30 12:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d892966-3a71-549b-9713-16ab222445ab with identifier: FH41507
2026-03-30 12:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d892966-3a71-549b-9713-16ab222445ab with scrape type 2
2026-03-30 12:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d892966-3a71-549b-9713-16ab222445ab with scrape type 2
2026-03-30 12:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8d892966-3a71-549b-9713-16ab222445ab, identifier: FH41507
2026-03-30 12:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8d892966-3a71-549b-9713-16ab222445ab with identifier: FH41507
2026-03-30 12:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8d892966-3a71-549b-9713-16ab222445ab with identifier: FH41507
2026-03-30 12:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8d892966-3a71-549b-9713-16ab222445ab with identifier: FH41507 to the API
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-31T15:51:21Z',
 'fuel_type': 'hybrid',
 'id': '8d892966-3a71-549b-9713-16ab222445ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH41507',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 171195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-05',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2015}
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH41507%27 HTTP/1.1" 200 None
2026-03-30 12:02:48 [auto1.nl] INFO: Saving data for FH41507: {'auction_closing_time': 1774972281.0, 'created_time': 1774292589.652205, 'last_price_update_time': 1774872168.626523}
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH41507') HTTP/1.1" 204 0
2026-03-30 12:02:48 [auto1.nl] INFO: Found listing with ID: MS88690
2026-03-30 12:02:48 [auto1.nl] INFO: Found listing with ID: BN42241
2026-03-30 12:02:48 [auto1.nl] INFO: Found listing with ID: NF89493
2026-03-30 12:02:48 [auto1.nl] INFO: Found listing with ID: ZS41016
2026-03-30 12:02:48 [auto1.nl] INFO: Found listing with ID: GE84449
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GE84449%27 HTTP/1.1" 200 None
2026-03-30 12:02:48 [auto1.nl] INFO: Scrape type for GE84449: 2
2026-03-30 12:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 149f7bc9-8942-5f80-80f8-39f30dff1430 with identifier: GE84449
2026-03-30 12:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 149f7bc9-8942-5f80-80f8-39f30dff1430 with scrape type 2
2026-03-30 12:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 149f7bc9-8942-5f80-80f8-39f30dff1430 with scrape type 2
2026-03-30 12:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 149f7bc9-8942-5f80-80f8-39f30dff1430, identifier: GE84449
2026-03-30 12:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 149f7bc9-8942-5f80-80f8-39f30dff1430 with identifier: GE84449
2026-03-30 12:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 149f7bc9-8942-5f80-80f8-39f30dff1430 with identifier: GE84449
2026-03-30 12:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 149f7bc9-8942-5f80-80f8-39f30dff1430 with identifier: GE84449 to the API
2026-03-30 12:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:57:13Z',
 'fuel_type': 'petrol',
 'id': '149f7bc9-8942-5f80-80f8-39f30dff1430',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE84449',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 43929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-22',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GE84449%27 HTTP/1.1" 200 None
2026-03-30 12:02:49 [auto1.nl] INFO: Saving data for GE84449: {'auction_closing_time': 1774972633.0, 'created_time': 1773134356.421061, 'last_price_update_time': 1774872169.17111}
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GE84449') HTTP/1.1" 204 0
2026-03-30 12:02:49 [auto1.nl] INFO: Found listing with ID: CF89454
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF89454%27 HTTP/1.1" 200 None
2026-03-30 12:02:49 [auto1.nl] INFO: Scrape type for CF89454: 1
2026-03-30 12:02:49 [auto1.nl] INFO: Found listing with ID: NU12312
2026-03-30 12:02:49 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB15106%27 HTTP/1.1" 200 None
2026-03-30 12:02:49 [auto1.nl] INFO: Scrape type for KB15106: 2
2026-03-30 12:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adb94721-a5f8-5b18-b229-1c2144692a0d with identifier: KB15106
2026-03-30 12:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adb94721-a5f8-5b18-b229-1c2144692a0d with scrape type 2
2026-03-30 12:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adb94721-a5f8-5b18-b229-1c2144692a0d with scrape type 2
2026-03-30 12:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: adb94721-a5f8-5b18-b229-1c2144692a0d, identifier: KB15106
2026-03-30 12:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: adb94721-a5f8-5b18-b229-1c2144692a0d with identifier: KB15106
2026-03-30 12:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: adb94721-a5f8-5b18-b229-1c2144692a0d with identifier: KB15106
2026-03-30 12:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: adb94721-a5f8-5b18-b229-1c2144692a0d with identifier: KB15106 to the API
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:04:55Z',
 'fuel_type': 'petrol',
 'id': 'adb94721-a5f8-5b18-b229-1c2144692a0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB15106',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 171780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2017}
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB15106%27 HTTP/1.1" 200 None
2026-03-30 12:02:49 [auto1.nl] INFO: Saving data for KB15106: {'auction_closing_time': 1774969495.0, 'created_time': 1773131904.125128, 'last_price_update_time': 1774872169.691059}
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB15106') HTTP/1.1" 204 0
2026-03-30 12:02:49 [auto1.nl] INFO: Found listing with ID: HT64280
2026-03-30 12:02:49 [auto1.nl] INFO: Found listing with ID: PA93170
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA93170%27 HTTP/1.1" 200 None
2026-03-30 12:02:49 [auto1.nl] INFO: Scrape type for PA93170: 1
2026-03-30 12:02:49 [auto1.nl] INFO: Found listing with ID: HW70134
2026-03-30 12:02:49 [auto1.nl] INFO: Found listing with ID: DG65388
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG65388%27 HTTP/1.1" 200 None
2026-03-30 12:02:49 [auto1.nl] INFO: Scrape type for DG65388: 1
2026-03-30 12:02:49 [auto1.nl] INFO: Found listing with ID: XV56308
2026-03-30 12:02:49 [auto1.nl] INFO: Found listing with ID: LL79212
2026-03-30 12:03:07 [scrapy.extensions.logstats] INFO: Crawled 26 pages (at 7 pages/min), scraped 22 items (at 11 items/min)
2026-03-30 12:03:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-30 12:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF70778> (referer: https://www.auto1.com/v1/car-details-view/DF70778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3fff219-d432-5802-a566-97cf7228eb76 with identifier: DF70778
2026-03-30 12:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3fff219-d432-5802-a566-97cf7228eb76 with scrape type 1
2026-03-30 12:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item b3fff219-d432-5802-a566-97cf7228eb76
2026-03-30 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_f195f68259ae701bfd05a73f4cbbf77d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_f195f68259ae701bfd05a73f4cbbf77d.jpg not downloaded yet
2026-03-30 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_f46bd6ebdb1e8b505a03857aed92ce7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_f46bd6ebdb1e8b505a03857aed92ce7d.jpg not downloaded yet
2026-03-30 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_d4ac278425ff883a717f7d4f92602dbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_d4ac278425ff883a717f7d4f92602dbe.jpg not downloaded yet
2026-03-30 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_1b536a0f3f75849fb870e2a39a1f7e70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_1b536a0f3f75849fb870e2a39a1f7e70.jpg not downloaded yet
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_d924aacf04df3950c17a34bdfdcd6a8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_d924aacf04df3950c17a34bdfdcd6a8f.jpg not downloaded yet
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_6ab50385d1af54d7a6972a8a05da4175.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_6ab50385d1af54d7a6972a8a05da4175.jpg not downloaded yet
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_79440663911cea79ea017038f25a3f70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_79440663911cea79ea017038f25a3f70.jpg not downloaded yet
2026-03-30 12:03:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.489(s), this was the 1st time calling it.
2026-03-30 12:03:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.5765879822175775 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:03:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.055(s), this was the 1st time calling it.
2026-03-30 12:03:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.582242083559406 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:03:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.127(s), this was the 1st time calling it.
2026-03-30 12:03:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.162767655945777 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW25358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_79440663911cea79ea017038f25a3f70.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74127d90>
2026-03-30 12:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_79440663911cea79ea017038f25a3f70.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_79440663911cea79ea017038f25a3f70.jpg saved to cache
2026-03-30 12:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3fff219-d432-5802-a566-97cf7228eb76
2026-03-30 12:03:30 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.207(s), this was the 1st time calling it.
2026-03-30 12:03:30 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.16783521018145 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:04:07 [scrapy.extensions.logstats] INFO: Crawled 28 pages (at 2 pages/min), scraped 22 items (at 0 items/min)
2026-03-30 12:04:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-30 12:04:30 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.280(s), this was the 1st time calling it.
2026-03-30 12:04:30 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.856692755391896 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR68176> (referer: https://www.auto1.com/v1/car-details-view/DR68176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c358697e-0988-56d6-88cc-ff79b3a8243f with identifier: DR68176
2026-03-30 12:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c358697e-0988-56d6-88cc-ff79b3a8243f with scrape type 1
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c358697e-0988-56d6-88cc-ff79b3a8243f
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_d0b5042b9bcd5751e954c0b5c5f7ac2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_d0b5042b9bcd5751e954c0b5c5f7ac2f.jpg already downloaded
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_627908e14e7a12fa6b46a3b5f3dc1954.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_627908e14e7a12fa6b46a3b5f3dc1954.jpg already downloaded
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_f78d03cdbe6a90ed416eaf965f8de7bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_f78d03cdbe6a90ed416eaf965f8de7bd.jpg already downloaded
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_ee5d7318af6bd12cd7040a97494a2a05.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_ee5d7318af6bd12cd7040a97494a2a05.jpg already downloaded
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_073fe0cbe73abba9c186717ac695b33f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_073fe0cbe73abba9c186717ac695b33f.jpg already downloaded
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_b280c226a9dac2efe491186fdadd3cc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_b280c226a9dac2efe491186fdadd3cc7.jpg already downloaded
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_d8b7138519c74720270bfb894af7e373.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_d8b7138519c74720270bfb894af7e373.jpg already downloaded
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_f544aca442d9f9ed251617c763627582.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_f544aca442d9f9ed251617c763627582.jpg already downloaded
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_b6114dab5af89d7fe043b712e78f921c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_b6114dab5af89d7fe043b712e78f921c.jpg already downloaded
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F3b%252F183b4630fed4dfb810b0fbf47e680f76%252Fpa%252FDR68176_b9285d76e289f6ea9dd0d82aa1366e82.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_b9285d76e289f6ea9dd0d82aa1366e82.jpg already downloaded
2026-03-30 12:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c358697e-0988-56d6-88cc-ff79b3a8243f, identifier: DR68176
2026-03-30 12:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c358697e-0988-56d6-88cc-ff79b3a8243f with identifier: DR68176
2026-03-30 12:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c358697e-0988-56d6-88cc-ff79b3a8243f with identifier: DR68176
2026-03-30 12:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c358697e-0988-56d6-88cc-ff79b3a8243f with identifier: DR68176 to the API
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DR68176>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:33:41Z',
 'fuel_type': 'petrol',
 'id': 'c358697e-0988-56d6-88cc-ff79b3a8243f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RJ053S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR68176',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 223966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_d0b5042b9bcd5751e954c0b5c5f7ac2f.jpg',
                'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_627908e14e7a12fa6b46a3b5f3dc1954.jpg',
                'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_f78d03cdbe6a90ed416eaf965f8de7bd.jpg',
                'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_ee5d7318af6bd12cd7040a97494a2a05.jpg',
                'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_073fe0cbe73abba9c186717ac695b33f.jpg',
                'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_b280c226a9dac2efe491186fdadd3cc7.jpg',
                'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_d8b7138519c74720270bfb894af7e373.jpg',
                'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_f544aca442d9f9ed251617c763627582.jpg',
                'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_b6114dab5af89d7fe043b712e78f921c.jpg',
                'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_b9285d76e289f6ea9dd0d82aa1366e82.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_d0b5042b9bcd5751e954c0b5c5f7ac2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_627908e14e7a12fa6b46a3b5f3dc1954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_f78d03cdbe6a90ed416eaf965f8de7bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_ee5d7318af6bd12cd7040a97494a2a05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_073fe0cbe73abba9c186717ac695b33f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_b280c226a9dac2efe491186fdadd3cc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_d8b7138519c74720270bfb894af7e373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_f544aca442d9f9ed251617c763627582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_b6114dab5af89d7fe043b712e78f921c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c358697e-0988-56d6-88cc-ff79b3a8243f/c358697e-0988-56d6-88cc-ff79b3a8243f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/3b/183b4630fed4dfb810b0fbf47e680f76/pa/DR68176_b9285d76e289f6ea9dd0d82aa1366e82.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR68176%27 HTTP/1.1" 200 None
2026-03-30 12:04:42 [auto1.nl] INFO: Saving data for DR68176: {'created_time': 1774872282.053214, 'last_price_update_time': 1774872282.05323, 'auction_closing_time': 1774971221.0}
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR68176') HTTP/1.1" 204 0
2026-03-30 12:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_6ab50385d1af54d7a6972a8a05da4175.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_d924aacf04df3950c17a34bdfdcd6a8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f78dbd0>
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_6ab50385d1af54d7a6972a8a05da4175.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_6ab50385d1af54d7a6972a8a05da4175.jpg saved to cache
2026-03-30 12:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3fff219-d432-5802-a566-97cf7228eb76
2026-03-30 12:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740be150>
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_d924aacf04df3950c17a34bdfdcd6a8f.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_d924aacf04df3950c17a34bdfdcd6a8f.jpg saved to cache
2026-03-30 12:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3fff219-d432-5802-a566-97cf7228eb76
2026-03-30 12:04:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.923(s), this was the 1st time calling it.
2026-03-30 12:04:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.644083578116672 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_1b536a0f3f75849fb870e2a39a1f7e70.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_d4ac278425ff883a717f7d4f92602dbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f78e2d0>
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_1b536a0f3f75849fb870e2a39a1f7e70.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_1b536a0f3f75849fb870e2a39a1f7e70.jpg saved to cache
2026-03-30 12:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3fff219-d432-5802-a566-97cf7228eb76
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f75ec90>
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_d4ac278425ff883a717f7d4f92602dbe.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_d4ac278425ff883a717f7d4f92602dbe.jpg saved to cache
2026-03-30 12:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3fff219-d432-5802-a566-97cf7228eb76
2026-03-30 12:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_f46bd6ebdb1e8b505a03857aed92ce7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_f195f68259ae701bfd05a73f4cbbf77d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740db7d0>
2026-03-30 12:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_f46bd6ebdb1e8b505a03857aed92ce7d.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_f46bd6ebdb1e8b505a03857aed92ce7d.jpg saved to cache
2026-03-30 12:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3fff219-d432-5802-a566-97cf7228eb76
2026-03-30 12:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7410da10>
2026-03-30 12:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F58%252F265826b94aa64211a3d6a6fa72215bf4%252Fpa%252FDF70778_f195f68259ae701bfd05a73f4cbbf77d.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_f195f68259ae701bfd05a73f4cbbf77d.jpg saved to cache
2026-03-30 12:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3fff219-d432-5802-a566-97cf7228eb76
2026-03-30 12:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3fff219-d432-5802-a566-97cf7228eb76, skipping ID generation
2026-03-30 12:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3fff219-d432-5802-a566-97cf7228eb76 with scrape type 1
2026-03-30 12:04:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3fff219-d432-5802-a566-97cf7228eb76 sending to next pipeline
2026-03-30 12:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b3fff219-d432-5802-a566-97cf7228eb76, identifier: DF70778
2026-03-30 12:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b3fff219-d432-5802-a566-97cf7228eb76 with identifier: DF70778
2026-03-30 12:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b3fff219-d432-5802-a566-97cf7228eb76 with identifier: DF70778
2026-03-30 12:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b3fff219-d432-5802-a566-97cf7228eb76 with identifier: DF70778 to the API
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_f195f68259ae701bfd05a73f4cbbf77d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:17:43Z',
 'fuel_type': 'hybrid',
 'id': 'b3fff219-d432-5802-a566-97cf7228eb76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF70778',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 153848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741466,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_f195f68259ae701bfd05a73f4cbbf77d.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741220,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_f46bd6ebdb1e8b505a03857aed92ce7d.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754928,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_d4ac278425ff883a717f7d4f92602dbe.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709945,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_1b536a0f3f75849fb870e2a39a1f7e70.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2156003,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_d924aacf04df3950c17a34bdfdcd6a8f.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622703,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_6ab50385d1af54d7a6972a8a05da4175.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3fff219-d432-5802-a566-97cf7228eb76/b3fff219-d432-5802-a566-97cf7228eb76_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/58/265826b94aa64211a3d6a6fa72215bf4/pa/DF70778_79440663911cea79ea017038f25a3f70.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.3 Hybrid Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2010}
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF70778%27 HTTP/1.1" 200 None
2026-03-30 12:04:43 [auto1.nl] INFO: Saving data for DF70778: {'created_time': 1774872283.798092, 'last_price_update_time': 1774872283.798105, 'auction_closing_time': 1774970263.0}
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF70778') HTTP/1.1" 204 0
2026-03-30 12:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL09883/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY89733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY46153> (referer: https://www.auto1.com/v1/car-details-view/UY46153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a370bad-234a-51d4-b415-da9f53bce6fa with identifier: UY46153
2026-03-30 12:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a370bad-234a-51d4-b415-da9f53bce6fa with scrape type 1
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2a370bad-234a-51d4-b415-da9f53bce6fa
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e05f93d62d3fab86097ef47a46f4f3%252Fpa%252FUY46153_b5a996c264b907a77d71a7786ce545fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_b5a996c264b907a77d71a7786ce545fa.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e05f93d62d3fab86097ef47a46f4f3%252Fpa%252FUY46153_a3ec205ec809eded59defa604a8a6641.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_a3ec205ec809eded59defa604a8a6641.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e05f93d62d3fab86097ef47a46f4f3%252Fpa%252FUY46153_2f093e84a69aeda90c5f91d781dc7ea6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_2f093e84a69aeda90c5f91d781dc7ea6.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e05f93d62d3fab86097ef47a46f4f3%252Fpa%252FUY46153_5a1f2b900ae2bc9639cd99e3260aeb5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_5a1f2b900ae2bc9639cd99e3260aeb5e.jpg already downloaded
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fe0%252F71e05f93d62d3fab86097ef47a46f4f3%252Fpa%252FUY46153_4304bc7e3f94cca5c8a226be327c3d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_4304bc7e3f94cca5c8a226be327c3d44.jpg already downloaded
2026-03-30 12:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2a370bad-234a-51d4-b415-da9f53bce6fa, identifier: UY46153
2026-03-30 12:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2a370bad-234a-51d4-b415-da9f53bce6fa with identifier: UY46153
2026-03-30 12:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2a370bad-234a-51d4-b415-da9f53bce6fa with identifier: UY46153
2026-03-30 12:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2a370bad-234a-51d4-b415-da9f53bce6fa with identifier: UY46153 to the API
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UY46153>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:52:10Z',
 'fuel_type': 'petrol',
 'id': '2a370bad-234a-51d4-b415-da9f53bce6fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PJ493V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY46153',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 254991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_b5a996c264b907a77d71a7786ce545fa.jpg',
                'https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_a3ec205ec809eded59defa604a8a6641.jpg',
                'https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_2f093e84a69aeda90c5f91d781dc7ea6.jpg',
                'https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_5a1f2b900ae2bc9639cd99e3260aeb5e.jpg',
                'https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_4304bc7e3f94cca5c8a226be327c3d44.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a370bad-234a-51d4-b415-da9f53bce6fa/2a370bad-234a-51d4-b415-da9f53bce6fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_b5a996c264b907a77d71a7786ce545fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a370bad-234a-51d4-b415-da9f53bce6fa/2a370bad-234a-51d4-b415-da9f53bce6fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_a3ec205ec809eded59defa604a8a6641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a370bad-234a-51d4-b415-da9f53bce6fa/2a370bad-234a-51d4-b415-da9f53bce6fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_2f093e84a69aeda90c5f91d781dc7ea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a370bad-234a-51d4-b415-da9f53bce6fa/2a370bad-234a-51d4-b415-da9f53bce6fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_5a1f2b900ae2bc9639cd99e3260aeb5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a370bad-234a-51d4-b415-da9f53bce6fa/2a370bad-234a-51d4-b415-da9f53bce6fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/e0/71e05f93d62d3fab86097ef47a46f4f3/pa/UY46153_4304bc7e3f94cca5c8a226be327c3d44.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY46153%27 HTTP/1.1" 200 None
2026-03-30 12:04:51 [auto1.nl] INFO: Saving data for UY46153: {'created_time': 1774872291.963236, 'last_price_update_time': 1774872291.963247, 'auction_closing_time': 1774972330.0}
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY46153') HTTP/1.1" 204 0
2026-03-30 12:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ30921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG57573/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA44396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.709(s), this was the 1st time calling it.
2026-03-30 12:04:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.3938455912604315 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG65388/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW25358> (referer: https://www.auto1.com/v1/car-details-view/VW25358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105 with identifier: VW25358
2026-03-30 12:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105 with scrape type 1
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_8a318a5b0e5e90fc9c33a2e07b9328c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_8a318a5b0e5e90fc9c33a2e07b9328c7.jpg already downloaded
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_4cd9e0c8c4e9afd64bfa92c380ce3178.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_4cd9e0c8c4e9afd64bfa92c380ce3178.jpg already downloaded
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_cc6d2aebf154a5803f36846bd2fe1066.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_cc6d2aebf154a5803f36846bd2fe1066.jpg already downloaded
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_f2b918b11d23c7426a7c73994baef4b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_f2b918b11d23c7426a7c73994baef4b5.jpg already downloaded
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_782e092116f48e2204f6cfb55d147040.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_782e092116f48e2204f6cfb55d147040.jpg already downloaded
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_19af0e6d3e57d29645969a62bcff2249.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_19af0e6d3e57d29645969a62bcff2249.jpg already downloaded
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_0ba3b61229f67400ff1b00ace1a40aad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_0ba3b61229f67400ff1b00ace1a40aad.jpg already downloaded
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_05ace5b08f00f15c3a5b34c46430063d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_05ace5b08f00f15c3a5b34c46430063d.jpg already downloaded
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_d5fb4481d6cba16a7db7c5a96b9f98bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_d5fb4481d6cba16a7db7c5a96b9f98bc.jpg already downloaded
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F5c%252Fb75c87402b28f96ecb7d1bf8c5c80328%252Fpa%252FVW25358_250c346ffbf7ee821f77e47b0b13f05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_250c346ffbf7ee821f77e47b0b13f05d.jpg already downloaded
2026-03-30 12:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105, identifier: VW25358
2026-03-30 12:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105 with identifier: VW25358
2026-03-30 12:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105 with identifier: VW25358
2026-03-30 12:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105 with identifier: VW25358 to the API
2026-03-30 12:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VW25358>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:39:05Z',
 'fuel_type': 'petrol',
 'id': '9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HJG-52-P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW25358',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 132241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_8a318a5b0e5e90fc9c33a2e07b9328c7.jpg',
                'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_4cd9e0c8c4e9afd64bfa92c380ce3178.jpg',
                'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_cc6d2aebf154a5803f36846bd2fe1066.jpg',
                'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_f2b918b11d23c7426a7c73994baef4b5.jpg',
                'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_782e092116f48e2204f6cfb55d147040.jpg',
                'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_19af0e6d3e57d29645969a62bcff2249.jpg',
                'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_0ba3b61229f67400ff1b00ace1a40aad.jpg',
                'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_05ace5b08f00f15c3a5b34c46430063d.jpg',
                'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_d5fb4481d6cba16a7db7c5a96b9f98bc.jpg',
                'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_250c346ffbf7ee821f77e47b0b13f05d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3147099,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_8a318a5b0e5e90fc9c33a2e07b9328c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009036,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_4cd9e0c8c4e9afd64bfa92c380ce3178.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_cc6d2aebf154a5803f36846bd2fe1066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_f2b918b11d23c7426a7c73994baef4b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_782e092116f48e2204f6cfb55d147040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_19af0e6d3e57d29645969a62bcff2249.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2303292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_0ba3b61229f67400ff1b00ace1a40aad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_05ace5b08f00f15c3a5b34c46430063d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_d5fb4481d6cba16a7db7c5a96b9f98bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105/9b0b4ff6-a12a-55e1-92d5-ed1d0f5fe105_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/5c/b75c87402b28f96ecb7d1bf8c5c80328/pa/VW25358_250c346ffbf7ee821f77e47b0b13f05d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW25358%27 HTTP/1.1" 200 None
2026-03-30 12:05:01 [auto1.nl] INFO: Saving data for VW25358: {'created_time': 1774872301.266345, 'last_price_update_time': 1774872301.266358, 'auction_closing_time': 1774971545.0}
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VW25358') HTTP/1.1" 204 0
2026-03-30 12:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA93170/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF89454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER66811> (referer: https://www.auto1.com/v1/car-details-view/ER66811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9365e338-1cdc-5fd3-b66b-bfda0a5b3af7 with identifier: ER66811
2026-03-30 12:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9365e338-1cdc-5fd3-b66b-bfda0a5b3af7 with scrape type 1
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9365e338-1cdc-5fd3-b66b-bfda0a5b3af7
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_53e9fd2cd771c7737f9f0c9102c74881.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_53e9fd2cd771c7737f9f0c9102c74881.jpg already downloaded
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_d59f87790da7ac2442324fc1dedc1926.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_d59f87790da7ac2442324fc1dedc1926.jpg already downloaded
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_ef5e346bb5610b063830a7c77d3dec91.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_ef5e346bb5610b063830a7c77d3dec91.jpg already downloaded
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_0ba1ebbfd6d7db58fb6c5096c313560a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_0ba1ebbfd6d7db58fb6c5096c313560a.jpg already downloaded
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_a0d76b91c045c8ba0bd5f4960bd71069.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_a0d76b91c045c8ba0bd5f4960bd71069.jpg already downloaded
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_bd135bdc7a7b0f121724c138a8ccd47c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_bd135bdc7a7b0f121724c138a8ccd47c.jpg already downloaded
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_f4f8b62422f83bbfc25aa091a9738c67.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_f4f8b62422f83bbfc25aa091a9738c67.jpg already downloaded
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_6d1f261bbc8e0ecbdd3d38b392f9a56a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_6d1f261bbc8e0ecbdd3d38b392f9a56a.jpg already downloaded
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_6f5fa559422e8137583de862f3ebb338.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_6f5fa559422e8137583de862f3ebb338.jpg already downloaded
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252Fad%252Fd0ad0a048e16f4aa0325e12e65e1abd0%252Fpa%252FER66811_03d0b4d471a1ff5bc1c578d511050c0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_03d0b4d471a1ff5bc1c578d511050c0c.jpg already downloaded
2026-03-30 12:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9365e338-1cdc-5fd3-b66b-bfda0a5b3af7, identifier: ER66811
2026-03-30 12:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9365e338-1cdc-5fd3-b66b-bfda0a5b3af7 with identifier: ER66811
2026-03-30 12:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9365e338-1cdc-5fd3-b66b-bfda0a5b3af7 with identifier: ER66811
2026-03-30 12:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9365e338-1cdc-5fd3-b66b-bfda0a5b3af7 with identifier: ER66811 to the API
2026-03-30 12:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ER66811>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:59:06Z',
 'fuel_type': 'petrol',
 'id': '9365e338-1cdc-5fd3-b66b-bfda0a5b3af7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '83ZKS1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER66811',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '1er',
 'odometer': 132371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_53e9fd2cd771c7737f9f0c9102c74881.jpg',
                'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_d59f87790da7ac2442324fc1dedc1926.jpg',
                'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_ef5e346bb5610b063830a7c77d3dec91.jpg',
                'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_0ba1ebbfd6d7db58fb6c5096c313560a.jpg',
                'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_a0d76b91c045c8ba0bd5f4960bd71069.jpg',
                'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_bd135bdc7a7b0f121724c138a8ccd47c.jpg',
                'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_f4f8b62422f83bbfc25aa091a9738c67.jpg',
                'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_6d1f261bbc8e0ecbdd3d38b392f9a56a.jpg',
                'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_6f5fa559422e8137583de862f3ebb338.jpg',
                'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_03d0b4d471a1ff5bc1c578d511050c0c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_53e9fd2cd771c7737f9f0c9102c74881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_d59f87790da7ac2442324fc1dedc1926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_ef5e346bb5610b063830a7c77d3dec91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_0ba1ebbfd6d7db58fb6c5096c313560a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_a0d76b91c045c8ba0bd5f4960bd71069.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_bd135bdc7a7b0f121724c138a8ccd47c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_f4f8b62422f83bbfc25aa091a9738c67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_6d1f261bbc8e0ecbdd3d38b392f9a56a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_6f5fa559422e8137583de862f3ebb338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9365e338-1cdc-5fd3-b66b-bfda0a5b3af7/9365e338-1cdc-5fd3-b66b-bfda0a5b3af7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/ad/d0ad0a048e16f4aa0325e12e65e1abd0/pa/ER66811_03d0b4d471a1ff5bc1c578d511050c0c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 12:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER66811%27 HTTP/1.1" 200 None
2026-03-30 12:05:06 [auto1.nl] INFO: Saving data for ER66811: {'created_time': 1774872306.35556, 'last_price_update_time': 1774872306.355588, 'auction_closing_time': 1774972746.0}
2026-03-30 12:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ER66811') HTTP/1.1" 204 0
2026-03-30 12:05:07 [scrapy.extensions.logstats] INFO: Crawled 40 pages (at 12 pages/min), scraped 27 items (at 5 items/min)
2026-03-30 12:05:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 163MiB
2026-03-30 12:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY89733> (referer: https://www.auto1.com/v1/car-details-view/EY89733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d84f203-6b52-5d5c-af34-1365a6fa5cfb with identifier: EY89733
2026-03-30 12:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d84f203-6b52-5d5c-af34-1365a6fa5cfb with scrape type 1
2026-03-30 12:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9d84f203-6b52-5d5c-af34-1365a6fa5cfb
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba13a511d1f1e6580da36a384ef736d%252Fpa%252FEY89733_56ef7a122c5e809710fd95f24b65df47.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_56ef7a122c5e809710fd95f24b65df47.jpg already downloaded
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba13a511d1f1e6580da36a384ef736d%252Fpa%252FEY89733_38f6a99436cb263d7d5d0a851e5137ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_38f6a99436cb263d7d5d0a851e5137ff.jpg already downloaded
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba13a511d1f1e6580da36a384ef736d%252Fpa%252FEY89733_d31881ab48aeb4f8efd574bc6dcff7e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_d31881ab48aeb4f8efd574bc6dcff7e1.jpg already downloaded
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba13a511d1f1e6580da36a384ef736d%252Fpa%252FEY89733_f0ad75e21c083e203c44d4eea2022396.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_f0ad75e21c083e203c44d4eea2022396.jpg already downloaded
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba13a511d1f1e6580da36a384ef736d%252Fpa%252FEY89733_c2742aefac12705d91a1094d2bcc0c52.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_c2742aefac12705d91a1094d2bcc0c52.jpg already downloaded
2026-03-30 12:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9d84f203-6b52-5d5c-af34-1365a6fa5cfb, identifier: EY89733
2026-03-30 12:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9d84f203-6b52-5d5c-af34-1365a6fa5cfb with identifier: EY89733
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:05:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 12:05:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9d84f203-6b52-5d5c-af34-1365a6fa5cfb with identifier: EY89733
2026-03-30 12:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9d84f203-6b52-5d5c-af34-1365a6fa5cfb with identifier: EY89733 to the API
2026-03-30 12:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY89733>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:17:22Z',
 'fuel_type': 'diesel',
 'id': '9d84f203-6b52-5d5c-af34-1365a6fa5cfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '84SFP6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY89733',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 386856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_56ef7a122c5e809710fd95f24b65df47.jpg',
                'https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_38f6a99436cb263d7d5d0a851e5137ff.jpg',
                'https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_d31881ab48aeb4f8efd574bc6dcff7e1.jpg',
                'https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_f0ad75e21c083e203c44d4eea2022396.jpg',
                'https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_c2742aefac12705d91a1094d2bcc0c52.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d84f203-6b52-5d5c-af34-1365a6fa5cfb/9d84f203-6b52-5d5c-af34-1365a6fa5cfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_56ef7a122c5e809710fd95f24b65df47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d84f203-6b52-5d5c-af34-1365a6fa5cfb/9d84f203-6b52-5d5c-af34-1365a6fa5cfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_38f6a99436cb263d7d5d0a851e5137ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d84f203-6b52-5d5c-af34-1365a6fa5cfb/9d84f203-6b52-5d5c-af34-1365a6fa5cfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_d31881ab48aeb4f8efd574bc6dcff7e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d84f203-6b52-5d5c-af34-1365a6fa5cfb/9d84f203-6b52-5d5c-af34-1365a6fa5cfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_f0ad75e21c083e203c44d4eea2022396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d84f203-6b52-5d5c-af34-1365a6fa5cfb/9d84f203-6b52-5d5c-af34-1365a6fa5cfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba13a511d1f1e6580da36a384ef736d/pa/EY89733_c2742aefac12705d91a1094d2bcc0c52.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2 Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2011}
2026-03-30 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY89733%27 HTTP/1.1" 200 None
2026-03-30 12:05:08 [auto1.nl] INFO: Saving data for EY89733: {'created_time': 1774872308.39473, 'last_price_update_time': 1774872308.394742, 'auction_closing_time': 1774970242.0}
2026-03-30 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY89733') HTTP/1.1" 204 0
2026-03-30 12:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF66593/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ30921> (referer: https://www.auto1.com/v1/car-details-view/BJ30921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bca9da0b-e39d-554d-95d8-d055ee050aad with identifier: BJ30921
2026-03-30 12:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca9da0b-e39d-554d-95d8-d055ee050aad with scrape type 1
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_6faadc7dd676038d10c975c86c223232.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_6faadc7dd676038d10c975c86c223232.jpg not downloaded yet
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_56d11c23357f05398399751e99476366.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_56d11c23357f05398399751e99476366.jpg not downloaded yet
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_3ce1b1109cb83961ba5cca8bd0263ba8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_3ce1b1109cb83961ba5cca8bd0263ba8.jpg not downloaded yet
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_138bc77a7a16675a8c6eb82357fd8bf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_138bc77a7a16675a8c6eb82357fd8bf1.jpg not downloaded yet
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_53ee4f755c19d191440079b03ce94504.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_53ee4f755c19d191440079b03ce94504.jpg not downloaded yet
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_9b6db982c9872a733ea7d7e856115e0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_9b6db982c9872a733ea7d7e856115e0e.jpg not downloaded yet
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_933a88f991c789c4aaea5e73e04d448f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_933a88f991c789c4aaea5e73e04d448f.jpg not downloaded yet
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_1117cda0e5be550c489f1778566e6ee8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_1117cda0e5be550c489f1778566e6ee8.jpg not downloaded yet
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_8e03fcfd1102100f35b349292091aa18.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_8e03fcfd1102100f35b349292091aa18.jpg not downloaded yet
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_b5125b1d33c8eb8ddc994683cc3eda2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_b5125b1d33c8eb8ddc994683cc3eda2f.jpg not downloaded yet
2026-03-30 12:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL09883> (referer: https://www.auto1.com/v1/car-details-view/AL09883/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_b5125b1d33c8eb8ddc994683cc3eda2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffdf69b8-30d7-57d2-b1df-7c320345ae09 with identifier: AL09883
2026-03-30 12:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffdf69b8-30d7-57d2-b1df-7c320345ae09 with scrape type 1
2026-03-30 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffdf69b8-30d7-57d2-b1df-7c320345ae09
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_fc8e63303a0c48b4229e62b7952e259a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_fc8e63303a0c48b4229e62b7952e259a.jpg already downloaded
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_baa8e7800d480f34367c9278e505f84a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_baa8e7800d480f34367c9278e505f84a.jpg already downloaded
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_61838cbe1b30d6f77706dd7228288efc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_61838cbe1b30d6f77706dd7228288efc.jpg already downloaded
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_b6cbc5090f203a9fd33b25ff4d043d23.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_b6cbc5090f203a9fd33b25ff4d043d23.jpg already downloaded
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_517b4bf2a9758d7b18517d32501649dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_517b4bf2a9758d7b18517d32501649dc.jpg already downloaded
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_1c5ee85ca9652a5691903d6802cb40a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_1c5ee85ca9652a5691903d6802cb40a8.jpg already downloaded
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_52b9d154eafd98fa078ba105e2d1c7f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_52b9d154eafd98fa078ba105e2d1c7f7.jpg already downloaded
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_cfec25a44c72063aa60527a1896ff533.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_cfec25a44c72063aa60527a1896ff533.jpg already downloaded
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_57ff226ab1c0a3de2003dba94a33e914.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_57ff226ab1c0a3de2003dba94a33e914.jpg already downloaded
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc5%252F5cc5f453f1e35a7439c93e79c5eb70d7%252Fpa%252FAL09883_157363aba960b7e675a22f4fb6d1406c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_157363aba960b7e675a22f4fb6d1406c.jpg already downloaded
2026-03-30 12:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ffdf69b8-30d7-57d2-b1df-7c320345ae09, identifier: AL09883
2026-03-30 12:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ffdf69b8-30d7-57d2-b1df-7c320345ae09 with identifier: AL09883
2026-03-30 12:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ffdf69b8-30d7-57d2-b1df-7c320345ae09 with identifier: AL09883
2026-03-30 12:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ffdf69b8-30d7-57d2-b1df-7c320345ae09 with identifier: AL09883 to the API
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL09883>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 585,
 'expiration_date': '2026-03-31T15:10:10Z',
 'fuel_type': 'electro',
 'id': 'ffdf69b8-30d7-57d2-b1df-7c320345ae09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'T661JS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL09883',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 14857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_fc8e63303a0c48b4229e62b7952e259a.jpg',
                'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_baa8e7800d480f34367c9278e505f84a.jpg',
                'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_61838cbe1b30d6f77706dd7228288efc.jpg',
                'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_b6cbc5090f203a9fd33b25ff4d043d23.jpg',
                'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_517b4bf2a9758d7b18517d32501649dc.jpg',
                'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_1c5ee85ca9652a5691903d6802cb40a8.jpg',
                'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_52b9d154eafd98fa078ba105e2d1c7f7.jpg',
                'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_cfec25a44c72063aa60527a1896ff533.jpg',
                'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_57ff226ab1c0a3de2003dba94a33e914.jpg',
                'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_157363aba960b7e675a22f4fb6d1406c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539031,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_fc8e63303a0c48b4229e62b7952e259a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_baa8e7800d480f34367c9278e505f84a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2182261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_61838cbe1b30d6f77706dd7228288efc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2045936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_b6cbc5090f203a9fd33b25ff4d043d23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_517b4bf2a9758d7b18517d32501649dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2150425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_1c5ee85ca9652a5691903d6802cb40a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1991398,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_52b9d154eafd98fa078ba105e2d1c7f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_cfec25a44c72063aa60527a1896ff533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_57ff226ab1c0a3de2003dba94a33e914.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdf69b8-30d7-57d2-b1df-7c320345ae09/ffdf69b8-30d7-57d2-b1df-7c320345ae09_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2256059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c5/5cc5f453f1e35a7439c93e79c5eb70d7/pa/AL09883_157363aba960b7e675a22f4fb6d1406c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia EV6 electric drive 430 kW GT 4WD',
 'transmission': 'automatic',
 'trim': 'GT 4WD',
 'year': 2023}
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL09883%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [auto1.nl] INFO: Saving data for AL09883: {'created_time': 1774872312.500112, 'last_price_update_time': 1774872312.500126, 'auction_closing_time': 1774969810.0}
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AL09883') HTTP/1.1" 204 0
2026-03-30 12:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_8e03fcfd1102100f35b349292091aa18.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b83330510>
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_b5125b1d33c8eb8ddc994683cc3eda2f.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_b5125b1d33c8eb8ddc994683cc3eda2f.jpg saved to cache
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG57573> (referer: https://www.auto1.com/v1/car-details-view/KG57573/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eebb410>
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_8e03fcfd1102100f35b349292091aa18.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_8e03fcfd1102100f35b349292091aa18.jpg saved to cache
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_1117cda0e5be550c489f1778566e6ee8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd279532-5aba-5e74-94c0-f344a10218b6 with identifier: KG57573
2026-03-30 12:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd279532-5aba-5e74-94c0-f344a10218b6 with scrape type 1
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_288ab4e0f84543d82817eade13914c82.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_288ab4e0f84543d82817eade13914c82.jpg not downloaded yet
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_aa472e5f14269e05efb7dc9217634897.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_aa472e5f14269e05efb7dc9217634897.jpg not downloaded yet
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_64dd87699cd4d1b98cdd33eba3b354ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_64dd87699cd4d1b98cdd33eba3b354ca.jpg not downloaded yet
2026-03-30 12:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_9b6db982c9872a733ea7d7e856115e0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_8c84ad2ee53ed69eea4c923c1d5bebee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_8c84ad2ee53ed69eea4c923c1d5bebee.jpg not downloaded yet
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_8fc482454255698500634cf25f3bf8fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_8fc482454255698500634cf25f3bf8fb.jpg not downloaded yet
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_7457083501a43e9408d437bc2914c5f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_7457083501a43e9408d437bc2914c5f7.jpg not downloaded yet
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_6659787425dc20ee6f64b374e491005d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_6659787425dc20ee6f64b374e491005d.jpg not downloaded yet
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee07290>
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_1117cda0e5be550c489f1778566e6ee8.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_1117cda0e5be550c489f1778566e6ee8.jpg saved to cache
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_6fd1ad31b6bee9e08e58d0771d6747ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_6fd1ad31b6bee9e08e58d0771d6747ce.jpg not downloaded yet
2026-03-30 12:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_933a88f991c789c4aaea5e73e04d448f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_64dd87699cd4d1b98cdd33eba3b354ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_2790c8fce35f846b935efadf04ff9cf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_2790c8fce35f846b935efadf04ff9cf6.jpg not downloaded yet
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_485027d5a361a5ddcc7e59193894869e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_485027d5a361a5ddcc7e59193894869e.jpg not downloaded yet
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee56250>
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_9b6db982c9872a733ea7d7e856115e0e.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_9b6db982c9872a733ea7d7e856115e0e.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_7457083501a43e9408d437bc2914c5f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740808d0>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_933a88f991c789c4aaea5e73e04d448f.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_933a88f991c789c4aaea5e73e04d448f.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_485027d5a361a5ddcc7e59193894869e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f75c9d0>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_64dd87699cd4d1b98cdd33eba3b354ca.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_64dd87699cd4d1b98cdd33eba3b354ca.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_6659787425dc20ee6f64b374e491005d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7407c9d0>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_7457083501a43e9408d437bc2914c5f7.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_7457083501a43e9408d437bc2914c5f7.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_2790c8fce35f846b935efadf04ff9cf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74098610>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_485027d5a361a5ddcc7e59193894869e.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_485027d5a361a5ddcc7e59193894869e.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f78e450>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_6659787425dc20ee6f64b374e491005d.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_6659787425dc20ee6f64b374e491005d.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_8fc482454255698500634cf25f3bf8fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee59090>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_2790c8fce35f846b935efadf04ff9cf6.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_2790c8fce35f846b935efadf04ff9cf6.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_6fd1ad31b6bee9e08e58d0771d6747ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7410ed90>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_8fc482454255698500634cf25f3bf8fb.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_8fc482454255698500634cf25f3bf8fb.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_8c84ad2ee53ed69eea4c923c1d5bebee.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA44396> (referer: https://www.auto1.com/v1/car-details-view/NA44396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f778b90>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_6fd1ad31b6bee9e08e58d0771d6747ce.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_6fd1ad31b6bee9e08e58d0771d6747ce.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_288ab4e0f84543d82817eade13914c82.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_aa472e5f14269e05efb7dc9217634897.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74083590>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_8c84ad2ee53ed69eea4c923c1d5bebee.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_8c84ad2ee53ed69eea4c923c1d5bebee.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_138bc77a7a16675a8c6eb82357fd8bf1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_3ce1b1109cb83961ba5cca8bd0263ba8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e547299-15bc-5b54-b5fd-4c2da4d32610 with identifier: NA44396
2026-03-30 12:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e547299-15bc-5b54-b5fd-4c2da4d32610 with scrape type 1
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_d0d2f4bc9dd45ae69be1435598a7174e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_d0d2f4bc9dd45ae69be1435598a7174e.jpg not downloaded yet
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_e7dfdbc47b6a9cbbd3e4c505d5123cf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_e7dfdbc47b6a9cbbd3e4c505d5123cf1.jpg not downloaded yet
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_79107b54bc6da92343ec7a0a796eaf61.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_79107b54bc6da92343ec7a0a796eaf61.jpg not downloaded yet
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f778850>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_288ab4e0f84543d82817eade13914c82.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_288ab4e0f84543d82817eade13914c82.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee1ab10>
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fe4%252Fece4eb1d9b2b93c5a198439d1c2431b4%252Fpa%252FKG57573_aa472e5f14269e05efb7dc9217634897.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_aa472e5f14269e05efb7dc9217634897.jpg saved to cache
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd279532-5aba-5e74-94c0-f344a10218b6
2026-03-30 12:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd279532-5aba-5e74-94c0-f344a10218b6, skipping ID generation
2026-03-30 12:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd279532-5aba-5e74-94c0-f344a10218b6 with scrape type 1
2026-03-30 12:05:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd279532-5aba-5e74-94c0-f344a10218b6 sending to next pipeline
2026-03-30 12:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fd279532-5aba-5e74-94c0-f344a10218b6, identifier: KG57573
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_cfa4a2b471d322e2d1197c6be7c769c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_cfa4a2b471d322e2d1197c6be7c769c9.jpg not downloaded yet
2026-03-30 12:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fd279532-5aba-5e74-94c0-f344a10218b6 with identifier: KG57573
2026-03-30 12:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fd279532-5aba-5e74-94c0-f344a10218b6 with identifier: KG57573
2026-03-30 12:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fd279532-5aba-5e74-94c0-f344a10218b6 with identifier: KG57573 to the API
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_aa472e5f14269e05efb7dc9217634897.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:16:20Z',
 'fuel_type': 'petrol',
 'id': 'fd279532-5aba-5e74-94c0-f344a10218b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'N861ZP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG57573',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 166120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_288ab4e0f84543d82817eade13914c82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_aa472e5f14269e05efb7dc9217634897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_64dd87699cd4d1b98cdd33eba3b354ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_8c84ad2ee53ed69eea4c923c1d5bebee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_8fc482454255698500634cf25f3bf8fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_7457083501a43e9408d437bc2914c5f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_6659787425dc20ee6f64b374e491005d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_6fd1ad31b6bee9e08e58d0771d6747ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_2790c8fce35f846b935efadf04ff9cf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd279532-5aba-5e74-94c0-f344a10218b6/fd279532-5aba-5e74-94c0-f344a10218b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/e4/ece4eb1d9b2b93c5a198439d1c2431b4/pa/KG57573_485027d5a361a5ddcc7e59193894869e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG57573%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [auto1.nl] INFO: Saving data for KG57573: {'created_time': 1774872314.470851, 'last_price_update_time': 1774872314.470862, 'auction_closing_time': 1774970180.0}
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KG57573') HTTP/1.1" 204 0
2026-03-30 12:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_56d11c23357f05398399751e99476366.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_6faadc7dd676038d10c975c86c223232.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG65388> (referer: https://www.auto1.com/v1/car-details-view/DG65388/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb7410>
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_138bc77a7a16675a8c6eb82357fd8bf1.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_138bc77a7a16675a8c6eb82357fd8bf1.jpg saved to cache
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee27e90>
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_3ce1b1109cb83961ba5cca8bd0263ba8.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_3ce1b1109cb83961ba5cca8bd0263ba8.jpg saved to cache
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_53ee4f755c19d191440079b03ce94504.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_e72b909a5a8a4050408478cd5a9d3676.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_e72b909a5a8a4050408478cd5a9d3676.jpg not downloaded yet
2026-03-30 12:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_95aadf914d671c68a991e8351def0612.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_95aadf914d671c68a991e8351def0612.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_274822c45332a0df129c04c679c611fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_274822c45332a0df129c04c679c611fb.jpg not downloaded yet
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7592ebd0>
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_56d11c23357f05398399751e99476366.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_56d11c23357f05398399751e99476366.jpg saved to cache
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee3fd50>
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_6faadc7dd676038d10c975c86c223232.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_6faadc7dd676038d10c975c86c223232.jpg saved to cache
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14167a8a-10af-59cc-a038-5c71178914e7 with identifier: DG65388
2026-03-30 12:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14167a8a-10af-59cc-a038-5c71178914e7 with scrape type 1
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_905f8c46481a23f8632dbab1b494cc1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_905f8c46481a23f8632dbab1b494cc1d.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_59eb0813314ee84bcf33da7685790403.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_59eb0813314ee84bcf33da7685790403.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_161022118606f56ec6b425ca06bcd23f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_161022118606f56ec6b425ca06bcd23f.jpg not downloaded yet
2026-03-30 12:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_79107b54bc6da92343ec7a0a796eaf61.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_cfa4a2b471d322e2d1197c6be7c769c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_73141d72d46532e7087a2248fc63e67e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_73141d72d46532e7087a2248fc63e67e.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_45db95d16521a2c621781bec693d70a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_45db95d16521a2c621781bec693d70a1.jpg not downloaded yet
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eebc4d0>
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98458931bdfe825e71fed9ff5e10ba70%252Fpa%252FBJ30921_53ee4f755c19d191440079b03ce94504.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_53ee4f755c19d191440079b03ce94504.jpg saved to cache
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bca9da0b-e39d-554d-95d8-d055ee050aad
2026-03-30 12:05:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bca9da0b-e39d-554d-95d8-d055ee050aad, skipping ID generation
2026-03-30 12:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca9da0b-e39d-554d-95d8-d055ee050aad with scrape type 1
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bca9da0b-e39d-554d-95d8-d055ee050aad sending to next pipeline
2026-03-30 12:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bca9da0b-e39d-554d-95d8-d055ee050aad, identifier: BJ30921
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_e7dfdbc47b6a9cbbd3e4c505d5123cf1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bca9da0b-e39d-554d-95d8-d055ee050aad with identifier: BJ30921
2026-03-30 12:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bca9da0b-e39d-554d-95d8-d055ee050aad with identifier: BJ30921
2026-03-30 12:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bca9da0b-e39d-554d-95d8-d055ee050aad with identifier: BJ30921 to the API
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_53ee4f755c19d191440079b03ce94504.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:41:18Z',
 'fuel_type': 'petrol',
 'id': 'bca9da0b-e39d-554d-95d8-d055ee050aad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ30921',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 205715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_6faadc7dd676038d10c975c86c223232.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_56d11c23357f05398399751e99476366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_3ce1b1109cb83961ba5cca8bd0263ba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_138bc77a7a16675a8c6eb82357fd8bf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_53ee4f755c19d191440079b03ce94504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_9b6db982c9872a733ea7d7e856115e0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_933a88f991c789c4aaea5e73e04d448f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_1117cda0e5be550c489f1778566e6ee8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_8e03fcfd1102100f35b349292091aa18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bca9da0b-e39d-554d-95d8-d055ee050aad/bca9da0b-e39d-554d-95d8-d055ee050aad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/45/98458931bdfe825e71fed9ff5e10ba70/pa/BJ30921_b5125b1d33c8eb8ddc994683cc3eda2f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ30921%27 HTTP/1.1" 200 None
2026-03-30 12:05:15 [auto1.nl] INFO: Saving data for BJ30921: {'created_time': 1774872315.43654, 'last_price_update_time': 1774872315.436551, 'auction_closing_time': 1774971678.0}
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BJ30921') HTTP/1.1" 204 0
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_3b024dbf67439ec87e65ed4c930abef2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_3b024dbf67439ec87e65ed4c930abef2.jpg not downloaded yet
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_3f098af34da08151c77eb0ecbc7381ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3f098af34da08151c77eb0ecbc7381ca.jpg not downloaded yet
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_3580c180df37cc980574ea1cfb76265a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3580c180df37cc980574ea1cfb76265a.jpg not downloaded yet
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ47828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_274822c45332a0df129c04c679c611fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV79930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed1efd0>
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_79107b54bc6da92343ec7a0a796eaf61.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_79107b54bc6da92343ec7a0a796eaf61.jpg saved to cache
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eedae90>
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_cfa4a2b471d322e2d1197c6be7c769c9.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_cfa4a2b471d322e2d1197c6be7c769c9.jpg saved to cache
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee18410>
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_e7dfdbc47b6a9cbbd3e4c505d5123cf1.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_e7dfdbc47b6a9cbbd3e4c505d5123cf1.jpg saved to cache
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_2fb4da619eac9645a6d842d67caf2eb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_2fb4da619eac9645a6d842d67caf2eb5.jpg not downloaded yet
2026-03-30 12:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_45db95d16521a2c621781bec693d70a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_eb26a3fe48091afec71d707ac6e64a9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_eb26a3fe48091afec71d707ac6e64a9b.jpg not downloaded yet
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eef7450>
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_274822c45332a0df129c04c679c611fb.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_274822c45332a0df129c04c679c611fb.jpg saved to cache
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_4b052d97edc25dfea71f219c1d37e22b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_4b052d97edc25dfea71f219c1d37e22b.jpg not downloaded yet
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_3a3fafd6a3803c8c019a44e3e978c50d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3a3fafd6a3803c8c019a44e3e978c50d.jpg not downloaded yet
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_4bfc22e246ef0bb000328327edbff59b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_4bfc22e246ef0bb000328327edbff59b.jpg not downloaded yet
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed7c510>
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_45db95d16521a2c621781bec693d70a1.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_45db95d16521a2c621781bec693d70a1.jpg saved to cache
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_905f8c46481a23f8632dbab1b494cc1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_2fb4da619eac9645a6d842d67caf2eb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_d0d2f4bc9dd45ae69be1435598a7174e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_3b024dbf67439ec87e65ed4c930abef2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3f098af34da08151c77eb0ecbc7381ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed7d5d0>
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_905f8c46481a23f8632dbab1b494cc1d.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_905f8c46481a23f8632dbab1b494cc1d.jpg saved to cache
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3a3fafd6a3803c8c019a44e3e978c50d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee3ef10>
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_2fb4da619eac9645a6d842d67caf2eb5.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_2fb4da619eac9645a6d842d67caf2eb5.jpg saved to cache
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7410ac10>
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_d0d2f4bc9dd45ae69be1435598a7174e.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_d0d2f4bc9dd45ae69be1435598a7174e.jpg saved to cache
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f77f650>
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_3b024dbf67439ec87e65ed4c930abef2.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_3b024dbf67439ec87e65ed4c930abef2.jpg saved to cache
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee36990>
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_3f098af34da08151c77eb0ecbc7381ca.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3f098af34da08151c77eb0ecbc7381ca.jpg saved to cache
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee59f50>
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_3a3fafd6a3803c8c019a44e3e978c50d.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3a3fafd6a3803c8c019a44e3e978c50d.jpg saved to cache
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_4bfc22e246ef0bb000328327edbff59b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3580c180df37cc980574ea1cfb76265a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_73141d72d46532e7087a2248fc63e67e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7407a090>
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_4bfc22e246ef0bb000328327edbff59b.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_4bfc22e246ef0bb000328327edbff59b.jpg saved to cache
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed16a90>
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_3580c180df37cc980574ea1cfb76265a.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3580c180df37cc980574ea1cfb76265a.jpg saved to cache
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75a3c7d0>
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_73141d72d46532e7087a2248fc63e67e.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_73141d72d46532e7087a2248fc63e67e.jpg saved to cache
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_eb26a3fe48091afec71d707ac6e64a9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_4b052d97edc25dfea71f219c1d37e22b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_95aadf914d671c68a991e8351def0612.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_59eb0813314ee84bcf33da7685790403.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee26b10>
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_eb26a3fe48091afec71d707ac6e64a9b.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_eb26a3fe48091afec71d707ac6e64a9b.jpg saved to cache
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_161022118606f56ec6b425ca06bcd23f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed7bcd0>
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_4b052d97edc25dfea71f219c1d37e22b.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_4b052d97edc25dfea71f219c1d37e22b.jpg saved to cache
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f721dd0>
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_95aadf914d671c68a991e8351def0612.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_95aadf914d671c68a991e8351def0612.jpg saved to cache
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee48d90>
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_59eb0813314ee84bcf33da7685790403.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_59eb0813314ee84bcf33da7685790403.jpg saved to cache
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740e3950>
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F30%252F443094d4bf03986594c6e3c55b290646%252Fpa%252FDG65388_161022118606f56ec6b425ca06bcd23f.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_161022118606f56ec6b425ca06bcd23f.jpg saved to cache
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14167a8a-10af-59cc-a038-5c71178914e7
2026-03-30 12:05:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14167a8a-10af-59cc-a038-5c71178914e7, skipping ID generation
2026-03-30 12:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14167a8a-10af-59cc-a038-5c71178914e7 with scrape type 1
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14167a8a-10af-59cc-a038-5c71178914e7 sending to next pipeline
2026-03-30 12:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14167a8a-10af-59cc-a038-5c71178914e7, identifier: DG65388
2026-03-30 12:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14167a8a-10af-59cc-a038-5c71178914e7 with identifier: DG65388
2026-03-30 12:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14167a8a-10af-59cc-a038-5c71178914e7 with identifier: DG65388
2026-03-30 12:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14167a8a-10af-59cc-a038-5c71178914e7 with identifier: DG65388 to the API
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_161022118606f56ec6b425ca06bcd23f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:36:04Z',
 'fuel_type': 'petrol',
 'id': '14167a8a-10af-59cc-a038-5c71178914e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'P216BJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG65388',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 31319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2816910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_905f8c46481a23f8632dbab1b494cc1d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_161022118606f56ec6b425ca06bcd23f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_45db95d16521a2c621781bec693d70a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3f098af34da08151c77eb0ecbc7381ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610782,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3580c180df37cc980574ea1cfb76265a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_2fb4da619eac9645a6d842d67caf2eb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2417605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_eb26a3fe48091afec71d707ac6e64a9b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795568,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_4b052d97edc25dfea71f219c1d37e22b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_3a3fafd6a3803c8c019a44e3e978c50d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14167a8a-10af-59cc-a038-5c71178914e7/14167a8a-10af-59cc-a038-5c71178914e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2465903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/30/443094d4bf03986594c6e3c55b290646/pa/DG65388_4bfc22e246ef0bb000328327edbff59b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2022}
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG65388%27 HTTP/1.1" 200 None
2026-03-30 12:05:18 [auto1.nl] INFO: Saving data for DG65388: {'created_time': 1774872318.142176, 'last_price_update_time': 1774872318.142188, 'auction_closing_time': 1774971364.0}
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DG65388') HTTP/1.1" 204 0
2026-03-30 12:05:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.372(s), this was the 1st time calling it.
2026-03-30 12:05:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.6075412782415865 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_e72b909a5a8a4050408478cd5a9d3676.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC11102/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed27390>
2026-03-30 12:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fc2%252Ff2c2783cfec833416e27bfd6bd851b51%252Fpa%252FNA44396_e72b909a5a8a4050408478cd5a9d3676.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_e72b909a5a8a4050408478cd5a9d3676.jpg saved to cache
2026-03-30 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e547299-15bc-5b54-b5fd-4c2da4d32610
2026-03-30 12:05:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e547299-15bc-5b54-b5fd-4c2da4d32610, skipping ID generation
2026-03-30 12:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e547299-15bc-5b54-b5fd-4c2da4d32610 with scrape type 1
2026-03-30 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e547299-15bc-5b54-b5fd-4c2da4d32610 sending to next pipeline
2026-03-30 12:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7e547299-15bc-5b54-b5fd-4c2da4d32610, identifier: NA44396
2026-03-30 12:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7e547299-15bc-5b54-b5fd-4c2da4d32610 with identifier: NA44396
2026-03-30 12:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7e547299-15bc-5b54-b5fd-4c2da4d32610 with identifier: NA44396
2026-03-30 12:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7e547299-15bc-5b54-b5fd-4c2da4d32610 with identifier: NA44396 to the API
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_e72b909a5a8a4050408478cd5a9d3676.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 193,
 'expiration_date': '2026-03-31T15:16:46Z',
 'fuel_type': 'petrol',
 'id': '7e547299-15bc-5b54-b5fd-4c2da4d32610',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA44396',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 246807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4840236,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_d0d2f4bc9dd45ae69be1435598a7174e.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_e7dfdbc47b6a9cbbd3e4c505d5123cf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_79107b54bc6da92343ec7a0a796eaf61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_cfa4a2b471d322e2d1197c6be7c769c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_e72b909a5a8a4050408478cd5a9d3676.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_95aadf914d671c68a991e8351def0612.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_274822c45332a0df129c04c679c611fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_59eb0813314ee84bcf33da7685790403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_73141d72d46532e7087a2248fc63e67e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e547299-15bc-5b54-b5fd-4c2da4d32610/7e547299-15bc-5b54-b5fd-4c2da4d32610_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/c2/f2c2783cfec833416e27bfd6bd851b51/pa/NA44396_3b024dbf67439ec87e65ed4c930abef2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA44396%27 HTTP/1.1" 200 None
2026-03-30 12:05:18 [auto1.nl] INFO: Saving data for NA44396: {'created_time': 1774872318.784784, 'last_price_update_time': 1774872318.784796, 'auction_closing_time': 1774970206.0}
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NA44396') HTTP/1.1" 204 0
2026-03-30 12:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF89454> (referer: https://www.auto1.com/v1/car-details-view/CF89454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL07359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd76a643-7d8b-5186-88b5-548f82cb653e with identifier: CF89454
2026-03-30 12:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd76a643-7d8b-5186-88b5-548f82cb653e with scrape type 1
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd76a643-7d8b-5186-88b5-548f82cb653e
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_d8ca43a748eca9c5eec5cab72a41648a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_d8ca43a748eca9c5eec5cab72a41648a.jpg already downloaded
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_2a4fea62cdde01799572902dc37e7729.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_2a4fea62cdde01799572902dc37e7729.jpg already downloaded
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_efe57045e0e24ed7db6e9d6335dcfffd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_efe57045e0e24ed7db6e9d6335dcfffd.jpg already downloaded
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_09c8d513cad7ee55f909351f6248a2d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_09c8d513cad7ee55f909351f6248a2d8.jpg already downloaded
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_442c6479a3e48411d31f42d3c5d81fa7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_442c6479a3e48411d31f42d3c5d81fa7.jpg already downloaded
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_0f0d261316ee50a0d284cceecd516d32.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_0f0d261316ee50a0d284cceecd516d32.jpg already downloaded
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_39e8280e2414a1ef9c6948ccffbcafd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_39e8280e2414a1ef9c6948ccffbcafd0.jpg already downloaded
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_de144e7aae299b5da06c56b0454c9826.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_de144e7aae299b5da06c56b0454c9826.jpg already downloaded
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_c8e632cb8b4508394c1b1fdd57e59638.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_c8e632cb8b4508394c1b1fdd57e59638.jpg already downloaded
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fbf%252F56bfd78518ae129f5f9cf4db313ddd9b%252Fpa%252FCF89454_31ccb6765ad4d927fdd9ca62d97cf6f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_31ccb6765ad4d927fdd9ca62d97cf6f4.jpg already downloaded
2026-03-30 12:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd76a643-7d8b-5186-88b5-548f82cb653e, identifier: CF89454
2026-03-30 12:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd76a643-7d8b-5186-88b5-548f82cb653e with identifier: CF89454
2026-03-30 12:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd76a643-7d8b-5186-88b5-548f82cb653e with identifier: CF89454
2026-03-30 12:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd76a643-7d8b-5186-88b5-548f82cb653e with identifier: CF89454 to the API
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CF89454>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:45:56Z',
 'fuel_type': 'diesel',
 'id': 'cd76a643-7d8b-5186-88b5-548f82cb653e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7XLJ51',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF89454',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 198794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_d8ca43a748eca9c5eec5cab72a41648a.jpg',
                'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_2a4fea62cdde01799572902dc37e7729.jpg',
                'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_efe57045e0e24ed7db6e9d6335dcfffd.jpg',
                'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_09c8d513cad7ee55f909351f6248a2d8.jpg',
                'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_442c6479a3e48411d31f42d3c5d81fa7.jpg',
                'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_0f0d261316ee50a0d284cceecd516d32.jpg',
                'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_39e8280e2414a1ef9c6948ccffbcafd0.jpg',
                'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_de144e7aae299b5da06c56b0454c9826.jpg',
                'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_c8e632cb8b4508394c1b1fdd57e59638.jpg',
                'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_31ccb6765ad4d927fdd9ca62d97cf6f4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_d8ca43a748eca9c5eec5cab72a41648a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_2a4fea62cdde01799572902dc37e7729.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_efe57045e0e24ed7db6e9d6335dcfffd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_09c8d513cad7ee55f909351f6248a2d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463463,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_442c6479a3e48411d31f42d3c5d81fa7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_0f0d261316ee50a0d284cceecd516d32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_39e8280e2414a1ef9c6948ccffbcafd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_de144e7aae299b5da06c56b0454c9826.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_c8e632cb8b4508394c1b1fdd57e59638.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd76a643-7d8b-5186-88b5-548f82cb653e/cd76a643-7d8b-5186-88b5-548f82cb653e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/bf/56bfd78518ae129f5f9cf4db313ddd9b/pa/CF89454_31ccb6765ad4d927fdd9ca62d97cf6f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF89454%27 HTTP/1.1" 200 None
2026-03-30 12:05:20 [auto1.nl] INFO: Saving data for CF89454: {'created_time': 1774872320.376891, 'last_price_update_time': 1774872320.376901, 'auction_closing_time': 1774971956.0}
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CF89454') HTTP/1.1" 204 0
2026-03-30 12:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:05:23 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.657(s), this was the 2nd time calling it.
2026-03-30 12:05:23 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.514665375952815 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.271(s), this was the 2nd time calling it.
2026-03-30 12:05:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.092510696963968 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF66593> (referer: https://www.auto1.com/v1/car-details-view/KF66593/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55749cba-5c45-528c-8334-716f6a5006a1 with identifier: KF66593
2026-03-30 12:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55749cba-5c45-528c-8334-716f6a5006a1 with scrape type 1
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 55749cba-5c45-528c-8334-716f6a5006a1
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_cf8d8c9cf822c98b0ab193adf8414af6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_cf8d8c9cf822c98b0ab193adf8414af6.jpg not downloaded yet
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_eb41f6bba2f94d8f4377a4c3a33a22bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_eb41f6bba2f94d8f4377a4c3a33a22bf.jpg not downloaded yet
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_44a5efb3d8c1bcee013b46287479c290.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_44a5efb3d8c1bcee013b46287479c290.jpg not downloaded yet
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_feb31e6c951ccc7094c2885b817c9bd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_feb31e6c951ccc7094c2885b817c9bd7.jpg not downloaded yet
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_502891ff33205df94f1478be15ebea5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_502891ff33205df94f1478be15ebea5d.jpg not downloaded yet
2026-03-30 12:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_eb41f6bba2f94d8f4377a4c3a33a22bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_cf8d8c9cf822c98b0ab193adf8414af6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_44a5efb3d8c1bcee013b46287479c290.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_feb31e6c951ccc7094c2885b817c9bd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f72dd10>
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_eb41f6bba2f94d8f4377a4c3a33a22bf.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_eb41f6bba2f94d8f4377a4c3a33a22bf.jpg saved to cache
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55749cba-5c45-528c-8334-716f6a5006a1
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb2c10>
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_cf8d8c9cf822c98b0ab193adf8414af6.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_cf8d8c9cf822c98b0ab193adf8414af6.jpg saved to cache
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55749cba-5c45-528c-8334-716f6a5006a1
2026-03-30 12:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_502891ff33205df94f1478be15ebea5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed64e10>
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_44a5efb3d8c1bcee013b46287479c290.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_44a5efb3d8c1bcee013b46287479c290.jpg saved to cache
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55749cba-5c45-528c-8334-716f6a5006a1
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee91b10>
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_feb31e6c951ccc7094c2885b817c9bd7.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_feb31e6c951ccc7094c2885b817c9bd7.jpg saved to cache
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55749cba-5c45-528c-8334-716f6a5006a1
2026-03-30 12:05:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.871(s), this was the 1st time calling it.
2026-03-30 12:05:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.049759020894285 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed29b10>
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa6%252F50a67d2f9dde9356fa87abb146da2273%252Fpa%252FKF66593_502891ff33205df94f1478be15ebea5d.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_502891ff33205df94f1478be15ebea5d.jpg saved to cache
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55749cba-5c45-528c-8334-716f6a5006a1
2026-03-30 12:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55749cba-5c45-528c-8334-716f6a5006a1, skipping ID generation
2026-03-30 12:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55749cba-5c45-528c-8334-716f6a5006a1 with scrape type 1
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55749cba-5c45-528c-8334-716f6a5006a1 sending to next pipeline
2026-03-30 12:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 55749cba-5c45-528c-8334-716f6a5006a1, identifier: KF66593
2026-03-30 12:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 55749cba-5c45-528c-8334-716f6a5006a1 with identifier: KF66593
2026-03-30 12:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 55749cba-5c45-528c-8334-716f6a5006a1 with identifier: KF66593
2026-03-30 12:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 55749cba-5c45-528c-8334-716f6a5006a1 with identifier: KF66593 to the API
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_502891ff33205df94f1478be15ebea5d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:17:28Z',
 'fuel_type': 'petrol',
 'id': '55749cba-5c45-528c-8334-716f6a5006a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '01LNN8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF66593',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 191541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_cf8d8c9cf822c98b0ab193adf8414af6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_eb41f6bba2f94d8f4377a4c3a33a22bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_44a5efb3d8c1bcee013b46287479c290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_feb31e6c951ccc7094c2885b817c9bd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55749cba-5c45-528c-8334-716f6a5006a1/55749cba-5c45-528c-8334-716f6a5006a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a6/50a67d2f9dde9356fa87abb146da2273/pa/KF66593_502891ff33205df94f1478be15ebea5d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2010}
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF66593%27 HTTP/1.1" 200 None
2026-03-30 12:05:32 [auto1.nl] INFO: Saving data for KF66593: {'created_time': 1774872332.710571, 'last_price_update_time': 1774872332.710624, 'auction_closing_time': 1774970248.0}
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KF66593') HTTP/1.1" 204 0
2026-03-30 12:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA87282/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV79930> (referer: https://www.auto1.com/v1/car-details-view/BV79930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a with identifier: BV79930
2026-03-30 12:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a with scrape type 1
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_56839df498702c85fae5bdae19fcca00.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_56839df498702c85fae5bdae19fcca00.jpg not downloaded yet
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_d50a6699c25372cee06abcbabc994838.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_d50a6699c25372cee06abcbabc994838.jpg not downloaded yet
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_2fa6796d6abd9557def8886f4fd703d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_2fa6796d6abd9557def8886f4fd703d7.jpg not downloaded yet
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_b5596011e7eebc4d396ea4484ca65446.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_b5596011e7eebc4d396ea4484ca65446.jpg not downloaded yet
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_1c6c65d1b7d128e42f38b425467c7bf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1c6c65d1b7d128e42f38b425467c7bf8.jpg not downloaded yet
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_62a2d56a2e0331f8144dd9aaf201cbfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_62a2d56a2e0331f8144dd9aaf201cbfa.jpg not downloaded yet
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_1127b75c6ccc96eba387f4802274c087.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1127b75c6ccc96eba387f4802274c087.jpg not downloaded yet
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_1213b8994b6bc39b411cbf01140dc4d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1213b8994b6bc39b411cbf01140dc4d8.jpg not downloaded yet
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_714e91efc33edd3ec42814a39edeadb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_714e91efc33edd3ec42814a39edeadb2.jpg not downloaded yet
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_de0c58839890d5cd97b2fa0a5b233d1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_de0c58839890d5cd97b2fa0a5b233d1a.jpg not downloaded yet
2026-03-30 12:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_b5596011e7eebc4d396ea4484ca65446.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_2fa6796d6abd9557def8886f4fd703d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_62a2d56a2e0331f8144dd9aaf201cbfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_de0c58839890d5cd97b2fa0a5b233d1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740718d0>
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_b5596011e7eebc4d396ea4484ca65446.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_b5596011e7eebc4d396ea4484ca65446.jpg saved to cache
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74069290>
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_2fa6796d6abd9557def8886f4fd703d7.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_2fa6796d6abd9557def8886f4fd703d7.jpg saved to cache
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb6b10>
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_62a2d56a2e0331f8144dd9aaf201cbfa.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_62a2d56a2e0331f8144dd9aaf201cbfa.jpg saved to cache
2026-03-30 12:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed30d50>
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_de0c58839890d5cd97b2fa0a5b233d1a.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_de0c58839890d5cd97b2fa0a5b233d1a.jpg saved to cache
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_d50a6699c25372cee06abcbabc994838.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC11102> (referer: https://www.auto1.com/v1/car-details-view/NC11102/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_56839df498702c85fae5bdae19fcca00.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_714e91efc33edd3ec42814a39edeadb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed45f50>
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_d50a6699c25372cee06abcbabc994838.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_d50a6699c25372cee06abcbabc994838.jpg saved to cache
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1213b8994b6bc39b411cbf01140dc4d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c7ff972-7133-5c3d-b735-df3f14549a80 with identifier: NC11102
2026-03-30 12:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7ff972-7133-5c3d-b735-df3f14549a80 with scrape type 1
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_ece7b57f1064d2bcb6a0ad2e6abc22df.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_ece7b57f1064d2bcb6a0ad2e6abc22df.jpg not downloaded yet
2026-03-30 12:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed43590>
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_56839df498702c85fae5bdae19fcca00.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_56839df498702c85fae5bdae19fcca00.jpg saved to cache
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7409af50>
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_714e91efc33edd3ec42814a39edeadb2.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_714e91efc33edd3ec42814a39edeadb2.jpg saved to cache
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_2bdb59496d504a9fe9476a6c528946bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_2bdb59496d504a9fe9476a6c528946bd.jpg not downloaded yet
2026-03-30 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1c6c65d1b7d128e42f38b425467c7bf8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_3be8d7dce3f7cf6f90df92af4893b243.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_3be8d7dce3f7cf6f90df92af4893b243.jpg not downloaded yet
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b741251d0>
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_1213b8994b6bc39b411cbf01140dc4d8.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1213b8994b6bc39b411cbf01140dc4d8.jpg saved to cache
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_4f13aae720d9353116424292eeaef1f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_4f13aae720d9353116424292eeaef1f1.jpg not downloaded yet
2026-03-30 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1127b75c6ccc96eba387f4802274c087.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_a897b1407a7569a254d7f4f1f99cefec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_a897b1407a7569a254d7f4f1f99cefec.jpg not downloaded yet
2026-03-30 12:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_ece7b57f1064d2bcb6a0ad2e6abc22df.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_0f47ed64b2aa7070d6526ed3b95aef08.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_0f47ed64b2aa7070d6526ed3b95aef08.jpg not downloaded yet
2026-03-30 12:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74079b10>
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_1c6c65d1b7d128e42f38b425467c7bf8.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1c6c65d1b7d128e42f38b425467c7bf8.jpg saved to cache
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_2bdb59496d504a9fe9476a6c528946bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_fb03c0773db13930d6a06e863a0753de.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_fb03c0773db13930d6a06e863a0753de.jpg not downloaded yet
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_52bcdce060138c1534c2ff4dcccc0b7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_52bcdce060138c1534c2ff4dcccc0b7e.jpg not downloaded yet
2026-03-30 12:05:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb3c10>
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fdc%252F46dca69d56ae7e2a342449887dae7066%252Fpa%252FBV79930_1127b75c6ccc96eba387f4802274c087.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1127b75c6ccc96eba387f4802274c087.jpg saved to cache
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a
2026-03-30 12:05:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a, skipping ID generation
2026-03-30 12:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a with scrape type 1
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a sending to next pipeline
2026-03-30 12:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a, identifier: BV79930
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7410bc50>
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_ece7b57f1064d2bcb6a0ad2e6abc22df.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_ece7b57f1064d2bcb6a0ad2e6abc22df.jpg saved to cache
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a with identifier: BV79930
2026-03-30 12:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a with identifier: BV79930
2026-03-30 12:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 369ec6b8-a4e0-568f-8354-b86dfb6b9a2a with identifier: BV79930 to the API
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1127b75c6ccc96eba387f4802274c087.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:05:34Z',
 'fuel_type': 'diesel',
 'id': '369ec6b8-a4e0-568f-8354-b86dfb6b9a2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '30SVT8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV79930',
 'listing': 'auction',
 'location': 'NL, Haarlem',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 307396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2607951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_56839df498702c85fae5bdae19fcca00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_d50a6699c25372cee06abcbabc994838.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2598155,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_2fa6796d6abd9557def8886f4fd703d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2527184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_b5596011e7eebc4d396ea4484ca65446.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2728769,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1c6c65d1b7d128e42f38b425467c7bf8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_62a2d56a2e0331f8144dd9aaf201cbfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2334098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1127b75c6ccc96eba387f4802274c087.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_1213b8994b6bc39b411cbf01140dc4d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2575106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_714e91efc33edd3ec42814a39edeadb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369ec6b8-a4e0-568f-8354-b86dfb6b9a2a/369ec6b8-a4e0-568f-8354-b86dfb6b9a2a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2770935,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/dc/46dca69d56ae7e2a342449887dae7066/pa/BV79930_de0c58839890d5cd97b2fa0a5b233d1a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV79930%27 HTTP/1.1" 200 None
2026-03-30 12:05:38 [auto1.nl] INFO: Saving data for BV79930: {'created_time': 1774872338.917486, 'last_price_update_time': 1774872338.917496, 'auction_closing_time': 1774969534.0}
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BV79930') HTTP/1.1" 204 0
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_1398e748ab9a991f27ca3d2084064cf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_1398e748ab9a991f27ca3d2084064cf7.jpg not downloaded yet
2026-03-30 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_4f13aae720d9353116424292eeaef1f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_a897b1407a7569a254d7f4f1f99cefec.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b741088d0>
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_2bdb59496d504a9fe9476a6c528946bd.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_2bdb59496d504a9fe9476a6c528946bd.jpg saved to cache
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_fb03c0773db13930d6a06e863a0753de.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_0f47ed64b2aa7070d6526ed3b95aef08.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_3be8d7dce3f7cf6f90df92af4893b243.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_2bf84172e02d69c320931f888c9962ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_2bf84172e02d69c320931f888c9962ae.jpg not downloaded yet
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee35e10>
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_4f13aae720d9353116424292eeaef1f1.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_4f13aae720d9353116424292eeaef1f1.jpg saved to cache
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed30450>
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_a897b1407a7569a254d7f4f1f99cefec.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_a897b1407a7569a254d7f4f1f99cefec.jpg saved to cache
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_1398e748ab9a991f27ca3d2084064cf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_52bcdce060138c1534c2ff4dcccc0b7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed75c50>
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_fb03c0773db13930d6a06e863a0753de.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_fb03c0773db13930d6a06e863a0753de.jpg saved to cache
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed29050>
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_0f47ed64b2aa7070d6526ed3b95aef08.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_0f47ed64b2aa7070d6526ed3b95aef08.jpg saved to cache
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a1510>
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_3be8d7dce3f7cf6f90df92af4893b243.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_3be8d7dce3f7cf6f90df92af4893b243.jpg saved to cache
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_2bf84172e02d69c320931f888c9962ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee3e750>
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_1398e748ab9a991f27ca3d2084064cf7.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_1398e748ab9a991f27ca3d2084064cf7.jpg saved to cache
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75732b50>
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_52bcdce060138c1534c2ff4dcccc0b7e.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_52bcdce060138c1534c2ff4dcccc0b7e.jpg saved to cache
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b81e3c610>
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F7d%252Fd87d518c43af7525cf5b2cd3b3d253f4%252Fpa%252FNC11102_2bf84172e02d69c320931f888c9962ae.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_2bf84172e02d69c320931f888c9962ae.jpg saved to cache
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c7ff972-7133-5c3d-b735-df3f14549a80
2026-03-30 12:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c7ff972-7133-5c3d-b735-df3f14549a80, skipping ID generation
2026-03-30 12:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7ff972-7133-5c3d-b735-df3f14549a80 with scrape type 1
2026-03-30 12:05:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c7ff972-7133-5c3d-b735-df3f14549a80 sending to next pipeline
2026-03-30 12:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c7ff972-7133-5c3d-b735-df3f14549a80, identifier: NC11102
2026-03-30 12:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c7ff972-7133-5c3d-b735-df3f14549a80 with identifier: NC11102
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 12:05:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c7ff972-7133-5c3d-b735-df3f14549a80 with identifier: NC11102
2026-03-30 12:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c7ff972-7133-5c3d-b735-df3f14549a80 with identifier: NC11102 to the API
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_2bf84172e02d69c320931f888c9962ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 18,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 398,
 'expiration_date': '2026-03-31T15:41:58Z',
 'fuel_type': 'hybrid',
 'id': '3c7ff972-7133-5c3d-b735-df3f14549a80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P626DH',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC11102',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 113069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_ece7b57f1064d2bcb6a0ad2e6abc22df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_2bdb59496d504a9fe9476a6c528946bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_3be8d7dce3f7cf6f90df92af4893b243.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_4f13aae720d9353116424292eeaef1f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_a897b1407a7569a254d7f4f1f99cefec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_0f47ed64b2aa7070d6526ed3b95aef08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_fb03c0773db13930d6a06e863a0753de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_52bcdce060138c1534c2ff4dcccc0b7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_1398e748ab9a991f27ca3d2084064cf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c7ff972-7133-5c3d-b735-df3f14549a80/3c7ff972-7133-5c3d-b735-df3f14549a80_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/7d/d87d518c43af7525cf5b2cd3b3d253f4/pa/NC11102_2bf84172e02d69c320931f888c9962ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Recharge Plug-in Hybrid Plus Dark AWD',
 'transmission': 'automatic',
 'trim': 'Plus Dark AWD',
 'year': 2022}
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC11102%27 HTTP/1.1" 200 None
2026-03-30 12:05:40 [auto1.nl] INFO: Saving data for NC11102: {'created_time': 1774872340.127173, 'last_price_update_time': 1774872340.127184, 'auction_closing_time': 1774971718.0}
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NC11102') HTTP/1.1" 204 0
2026-03-30 12:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL07359> (referer: https://www.auto1.com/v1/car-details-view/NL07359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0c17e27-6dae-5692-bbf1-782f898bacdb with identifier: NL07359
2026-03-30 12:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0c17e27-6dae-5692-bbf1-782f898bacdb with scrape type 1
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0c17e27-6dae-5692-bbf1-782f898bacdb
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_c40e69ed4fec71157addf34c27a4849d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_c40e69ed4fec71157addf34c27a4849d.jpg already downloaded
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_0e70c6c7ef1bb0a29802d730734426e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_0e70c6c7ef1bb0a29802d730734426e6.jpg already downloaded
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_8251bf2a96b4100ef689e4017ecb84f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_8251bf2a96b4100ef689e4017ecb84f3.jpg already downloaded
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_6bb4b0359f0e05ca073d8314a4aa307f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_6bb4b0359f0e05ca073d8314a4aa307f.jpg already downloaded
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_4acc8d4ecca8e41be0cf75ca41e176ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_4acc8d4ecca8e41be0cf75ca41e176ee.jpg already downloaded
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_b67267e67c74cd481ad0c78381092e5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_b67267e67c74cd481ad0c78381092e5f.jpg already downloaded
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_516f997360f73c14cc31261e4cbc4eab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_516f997360f73c14cc31261e4cbc4eab.jpg already downloaded
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_6eec6d55cb54e257ba5c4ec77e5dfcf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_6eec6d55cb54e257ba5c4ec77e5dfcf1.jpg already downloaded
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_69babec4199c73ce8db5c1f146fb1d3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_69babec4199c73ce8db5c1f146fb1d3d.jpg already downloaded
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fbd%252F11bde865bba5adeb035a263f1524ba6e%252Fpa%252FNL07359_39b1989b0f0660432c54454991c6a8d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_39b1989b0f0660432c54454991c6a8d8.jpg already downloaded
2026-03-30 12:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e0c17e27-6dae-5692-bbf1-782f898bacdb, identifier: NL07359
2026-03-30 12:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e0c17e27-6dae-5692-bbf1-782f898bacdb with identifier: NL07359
2026-03-30 12:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e0c17e27-6dae-5692-bbf1-782f898bacdb with identifier: NL07359
2026-03-30 12:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e0c17e27-6dae-5692-bbf1-782f898bacdb with identifier: NL07359 to the API
2026-03-30 12:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NL07359>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:08:02Z',
 'fuel_type': 'petrol',
 'id': 'e0c17e27-6dae-5692-bbf1-782f898bacdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SZ978V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL07359',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 167337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_c40e69ed4fec71157addf34c27a4849d.jpg',
                'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_0e70c6c7ef1bb0a29802d730734426e6.jpg',
                'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_8251bf2a96b4100ef689e4017ecb84f3.jpg',
                'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_6bb4b0359f0e05ca073d8314a4aa307f.jpg',
                'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_4acc8d4ecca8e41be0cf75ca41e176ee.jpg',
                'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_b67267e67c74cd481ad0c78381092e5f.jpg',
                'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_516f997360f73c14cc31261e4cbc4eab.jpg',
                'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_6eec6d55cb54e257ba5c4ec77e5dfcf1.jpg',
                'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_69babec4199c73ce8db5c1f146fb1d3d.jpg',
                'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_39b1989b0f0660432c54454991c6a8d8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_c40e69ed4fec71157addf34c27a4849d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_0e70c6c7ef1bb0a29802d730734426e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_8251bf2a96b4100ef689e4017ecb84f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_6bb4b0359f0e05ca073d8314a4aa307f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_4acc8d4ecca8e41be0cf75ca41e176ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_b67267e67c74cd481ad0c78381092e5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_516f997360f73c14cc31261e4cbc4eab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_6eec6d55cb54e257ba5c4ec77e5dfcf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_69babec4199c73ce8db5c1f146fb1d3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0c17e27-6dae-5692-bbf1-782f898bacdb/e0c17e27-6dae-5692-bbf1-782f898bacdb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/bd/11bde865bba5adeb035a263f1524ba6e/pa/NL07359_39b1989b0f0660432c54454991c6a8d8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2018}
2026-03-30 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL07359%27 HTTP/1.1" 200 None
2026-03-30 12:05:46 [auto1.nl] INFO: Saving data for NL07359: {'created_time': 1774872346.338972, 'last_price_update_time': 1774872346.338985, 'auction_closing_time': 1774969682.0}
2026-03-30 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL07359') HTTP/1.1" 204 0
2026-03-30 12:05:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.631(s), this was the 2nd time calling it.
2026-03-30 12:05:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.525793780841285 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA87282> (referer: https://www.auto1.com/v1/car-details-view/MA87282/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6701a649-d24b-5328-af98-4d9ff199033f with identifier: MA87282
2026-03-30 12:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6701a649-d24b-5328-af98-4d9ff199033f with scrape type 1
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6701a649-d24b-5328-af98-4d9ff199033f
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_4525a8968fbc8f23d25c2a5766a89069.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_4525a8968fbc8f23d25c2a5766a89069.jpg already downloaded
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_fa91d715c6fbad1376f9be9ed40bc480.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_fa91d715c6fbad1376f9be9ed40bc480.jpg already downloaded
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_67f9b9af4ec1c8ad58e5b776dbcc78dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_67f9b9af4ec1c8ad58e5b776dbcc78dd.jpg already downloaded
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_dd0f0821a1d693f6f37c2a36449ca820.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_dd0f0821a1d693f6f37c2a36449ca820.jpg already downloaded
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_25827e6a1a5630f3704298c1ab907a23.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_25827e6a1a5630f3704298c1ab907a23.jpg already downloaded
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_268013c2171207e9ab75e4cce6e1e218.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_268013c2171207e9ab75e4cce6e1e218.jpg already downloaded
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_ba4e4fa0a2a9b10754a290db729c07b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_ba4e4fa0a2a9b10754a290db729c07b5.jpg already downloaded
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_33e2c13abd453cf28a497f965a5335f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_33e2c13abd453cf28a497f965a5335f2.jpg already downloaded
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_ccd27dcbd670e1fe920080072b172698.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_ccd27dcbd670e1fe920080072b172698.jpg already downloaded
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F52%252F295274400130d353250f8232f150acf2%252Fpa%252FMA87282_ff50511c9c41fa7eb46e3c5584e3ff93.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_ff50511c9c41fa7eb46e3c5584e3ff93.jpg already downloaded
2026-03-30 12:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6701a649-d24b-5328-af98-4d9ff199033f, identifier: MA87282
2026-03-30 12:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6701a649-d24b-5328-af98-4d9ff199033f with identifier: MA87282
2026-03-30 12:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6701a649-d24b-5328-af98-4d9ff199033f with identifier: MA87282
2026-03-30 12:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6701a649-d24b-5328-af98-4d9ff199033f with identifier: MA87282 to the API
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MA87282>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:40:24Z',
 'fuel_type': 'petrol',
 'id': '6701a649-d24b-5328-af98-4d9ff199033f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '2THF71',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA87282',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 102394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_4525a8968fbc8f23d25c2a5766a89069.jpg',
                'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_fa91d715c6fbad1376f9be9ed40bc480.jpg',
                'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_67f9b9af4ec1c8ad58e5b776dbcc78dd.jpg',
                'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_dd0f0821a1d693f6f37c2a36449ca820.jpg',
                'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_25827e6a1a5630f3704298c1ab907a23.jpg',
                'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_268013c2171207e9ab75e4cce6e1e218.jpg',
                'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_ba4e4fa0a2a9b10754a290db729c07b5.jpg',
                'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_33e2c13abd453cf28a497f965a5335f2.jpg',
                'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_ccd27dcbd670e1fe920080072b172698.jpg',
                'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_ff50511c9c41fa7eb46e3c5584e3ff93.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_4525a8968fbc8f23d25c2a5766a89069.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_fa91d715c6fbad1376f9be9ed40bc480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_67f9b9af4ec1c8ad58e5b776dbcc78dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_dd0f0821a1d693f6f37c2a36449ca820.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_25827e6a1a5630f3704298c1ab907a23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_268013c2171207e9ab75e4cce6e1e218.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_ba4e4fa0a2a9b10754a290db729c07b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_33e2c13abd453cf28a497f965a5335f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_ccd27dcbd670e1fe920080072b172698.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6701a649-d24b-5328-af98-4d9ff199033f/6701a649-d24b-5328-af98-4d9ff199033f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/52/295274400130d353250f8232f150acf2/pa/MA87282_ff50511c9c41fa7eb46e3c5584e3ff93.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 VVT-i Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2013}
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MA87282%27 HTTP/1.1" 200 None
2026-03-30 12:05:47 [auto1.nl] INFO: Saving data for MA87282: {'created_time': 1774872347.960258, 'last_price_update_time': 1774872347.960271, 'auction_closing_time': 1774971624.0}
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MA87282') HTTP/1.1" 204 0
2026-03-30 12:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV35300/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV35300> (referer: https://www.auto1.com/v1/car-details-view/GV35300/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 250f80f8-ffde-5e6d-a6cc-e005530aa84d with identifier: GV35300
2026-03-30 12:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 250f80f8-ffde-5e6d-a6cc-e005530aa84d with scrape type 1
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 250f80f8-ffde-5e6d-a6cc-e005530aa84d
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_528d0c9ea615e1b7007948638226fc09.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_528d0c9ea615e1b7007948638226fc09.jpg already downloaded
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_880704dde6ff873107142455ae011a6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_880704dde6ff873107142455ae011a6c.jpg already downloaded
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_52099b0a4b0a3beb2a9764cfaee91dee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_52099b0a4b0a3beb2a9764cfaee91dee.jpg already downloaded
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_9c012e2d740dd0cdd7a02432dfc21902.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_9c012e2d740dd0cdd7a02432dfc21902.jpg already downloaded
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_e20314f4e8b32ac82dc2131f25cb50e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_e20314f4e8b32ac82dc2131f25cb50e8.jpg already downloaded
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_9ccdc9790f8d4add4a09c868b8cf07eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_9ccdc9790f8d4add4a09c868b8cf07eb.jpg already downloaded
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_65882bcec3ab392d55191ff943f4ba44.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_65882bcec3ab392d55191ff943f4ba44.jpg already downloaded
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_d2b16681e0de36afac12be1855f1701c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_d2b16681e0de36afac12be1855f1701c.jpg already downloaded
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_ab05ee901f5f565b6c9b99b4049c2151.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_ab05ee901f5f565b6c9b99b4049c2151.jpg already downloaded
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F25%252F552573dcce3730bb2dbd09eff0e5ad19%252Fpa%252FGV35300_df5496d82b261ab33b01db678b72cbc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_df5496d82b261ab33b01db678b72cbc9.jpg already downloaded
2026-03-30 12:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 250f80f8-ffde-5e6d-a6cc-e005530aa84d, identifier: GV35300
2026-03-30 12:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 250f80f8-ffde-5e6d-a6cc-e005530aa84d with identifier: GV35300
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 12:06:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 250f80f8-ffde-5e6d-a6cc-e005530aa84d with identifier: GV35300
2026-03-30 12:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 250f80f8-ffde-5e6d-a6cc-e005530aa84d with identifier: GV35300 to the API
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GV35300>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:23:18Z',
 'fuel_type': 'petrol',
 'id': '250f80f8-ffde-5e6d-a6cc-e005530aa84d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'G835KF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV35300',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 64943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_528d0c9ea615e1b7007948638226fc09.jpg',
                'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_880704dde6ff873107142455ae011a6c.jpg',
                'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_52099b0a4b0a3beb2a9764cfaee91dee.jpg',
                'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_9c012e2d740dd0cdd7a02432dfc21902.jpg',
                'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_e20314f4e8b32ac82dc2131f25cb50e8.jpg',
                'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_9ccdc9790f8d4add4a09c868b8cf07eb.jpg',
                'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_65882bcec3ab392d55191ff943f4ba44.jpg',
                'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_d2b16681e0de36afac12be1855f1701c.jpg',
                'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_ab05ee901f5f565b6c9b99b4049c2151.jpg',
                'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_df5496d82b261ab33b01db678b72cbc9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_528d0c9ea615e1b7007948638226fc09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_880704dde6ff873107142455ae011a6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_52099b0a4b0a3beb2a9764cfaee91dee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_9c012e2d740dd0cdd7a02432dfc21902.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_e20314f4e8b32ac82dc2131f25cb50e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_9ccdc9790f8d4add4a09c868b8cf07eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_65882bcec3ab392d55191ff943f4ba44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_d2b16681e0de36afac12be1855f1701c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_ab05ee901f5f565b6c9b99b4049c2151.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_250f80f8-ffde-5e6d-a6cc-e005530aa84d/250f80f8-ffde-5e6d-a6cc-e005530aa84d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/25/552573dcce3730bb2dbd09eff0e5ad19/pa/GV35300_df5496d82b261ab33b01db678b72cbc9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2019}
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV35300%27 HTTP/1.1" 200 None
2026-03-30 12:06:04 [auto1.nl] INFO: Saving data for GV35300: {'created_time': 1774872364.49766, 'last_price_update_time': 1774872364.49767, 'auction_closing_time': 1774970598.0}
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV35300') HTTP/1.1" 204 0
2026-03-30 12:06:07 [scrapy.extensions.logstats] INFO: Crawled 60 pages (at 20 pages/min), scraped 40 items (at 13 items/min)
2026-03-30 12:06:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-30 12:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ47828> (referer: https://www.auto1.com/v1/car-details-view/GZ47828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfadca8b-9ab5-5417-a10a-263109181686 with identifier: GZ47828
2026-03-30 12:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfadca8b-9ab5-5417-a10a-263109181686 with scrape type 1
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_25a1a2b31461ca0108dac5cea6375b9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_25a1a2b31461ca0108dac5cea6375b9b.jpg not downloaded yet
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_7cda78c6fc0b27bf2dc9f048b3ce5f08.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_7cda78c6fc0b27bf2dc9f048b3ce5f08.jpg not downloaded yet
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_19f09537751905273aa40b581eb3fa68.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_19f09537751905273aa40b581eb3fa68.jpg not downloaded yet
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_b2f45017f4b03810589228bc5dbc2598.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_b2f45017f4b03810589228bc5dbc2598.jpg not downloaded yet
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_63d3e204309c24889f172a5cffb6dc47.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_63d3e204309c24889f172a5cffb6dc47.jpg not downloaded yet
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_c340c55359c98ab4187673fab5b860f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_c340c55359c98ab4187673fab5b860f4.jpg not downloaded yet
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_f8959c32904328a65f787dc3fec128fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_f8959c32904328a65f787dc3fec128fd.jpg not downloaded yet
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_fa1fbb4c7b53cfd183505800ad025160.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_fa1fbb4c7b53cfd183505800ad025160.jpg not downloaded yet
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_547aa801cfa720621e2c0d0b6e236b2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_547aa801cfa720621e2c0d0b6e236b2f.jpg not downloaded yet
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_37224d70743663603acd7a22a9c4522e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_37224d70743663603acd7a22a9c4522e.jpg not downloaded yet
2026-03-30 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_19f09537751905273aa40b581eb3fa68.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_c340c55359c98ab4187673fab5b860f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed64e50>
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_19f09537751905273aa40b581eb3fa68.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_19f09537751905273aa40b581eb3fa68.jpg saved to cache
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_fa1fbb4c7b53cfd183505800ad025160.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_37224d70743663603acd7a22a9c4522e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed32190>
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_c340c55359c98ab4187673fab5b860f4.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_c340c55359c98ab4187673fab5b860f4.jpg saved to cache
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_25a1a2b31461ca0108dac5cea6375b9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_547aa801cfa720621e2c0d0b6e236b2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_f8959c32904328a65f787dc3fec128fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_7cda78c6fc0b27bf2dc9f048b3ce5f08.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed67b90>
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_fa1fbb4c7b53cfd183505800ad025160.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_fa1fbb4c7b53cfd183505800ad025160.jpg saved to cache
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f733950>
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_37224d70743663603acd7a22a9c4522e.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_37224d70743663603acd7a22a9c4522e.jpg saved to cache
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee8a250>
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_25a1a2b31461ca0108dac5cea6375b9b.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_25a1a2b31461ca0108dac5cea6375b9b.jpg saved to cache
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740da610>
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_547aa801cfa720621e2c0d0b6e236b2f.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_547aa801cfa720621e2c0d0b6e236b2f.jpg saved to cache
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eece110>
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_f8959c32904328a65f787dc3fec128fd.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_f8959c32904328a65f787dc3fec128fd.jpg saved to cache
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f777110>
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_7cda78c6fc0b27bf2dc9f048b3ce5f08.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_7cda78c6fc0b27bf2dc9f048b3ce5f08.jpg saved to cache
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_b2f45017f4b03810589228bc5dbc2598.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_63d3e204309c24889f172a5cffb6dc47.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee68990>
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_b2f45017f4b03810589228bc5dbc2598.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_b2f45017f4b03810589228bc5dbc2598.jpg saved to cache
2026-03-30 12:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed28990>
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fa9%252F55a9a3206caa2299faeca84a3d18641e%252Fpa%252FGZ47828_63d3e204309c24889f172a5cffb6dc47.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_63d3e204309c24889f172a5cffb6dc47.jpg saved to cache
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfadca8b-9ab5-5417-a10a-263109181686
2026-03-30 12:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfadca8b-9ab5-5417-a10a-263109181686, skipping ID generation
2026-03-30 12:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfadca8b-9ab5-5417-a10a-263109181686 with scrape type 1
2026-03-30 12:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfadca8b-9ab5-5417-a10a-263109181686 sending to next pipeline
2026-03-30 12:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cfadca8b-9ab5-5417-a10a-263109181686, identifier: GZ47828
2026-03-30 12:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cfadca8b-9ab5-5417-a10a-263109181686 with identifier: GZ47828
2026-03-30 12:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cfadca8b-9ab5-5417-a10a-263109181686 with identifier: GZ47828
2026-03-30 12:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cfadca8b-9ab5-5417-a10a-263109181686 with identifier: GZ47828 to the API
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_63d3e204309c24889f172a5cffb6dc47.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '4.2L',
 'engine_horse_power': 310,
 'expiration_date': '2026-03-31T15:36:10Z',
 'fuel_type': 'petrol',
 'id': 'cfadca8b-9ab5-5417-a10a-263109181686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'G505GP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ47828',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 147854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2732086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_25a1a2b31461ca0108dac5cea6375b9b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2734836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_7cda78c6fc0b27bf2dc9f048b3ce5f08.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628215,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_19f09537751905273aa40b581eb3fa68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2680676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_b2f45017f4b03810589228bc5dbc2598.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2563108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_63d3e204309c24889f172a5cffb6dc47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_c340c55359c98ab4187673fab5b860f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2716657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_f8959c32904328a65f787dc3fec128fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_fa1fbb4c7b53cfd183505800ad025160.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_547aa801cfa720621e2c0d0b6e236b2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfadca8b-9ab5-5417-a10a-263109181686/cfadca8b-9ab5-5417-a10a-263109181686_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/a9/55a9a3206caa2299faeca84a3d18641e/pa/GZ47828_37224d70743663603acd7a22a9c4522e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 4.2 V8',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ47828%27 HTTP/1.1" 200 None
2026-03-30 12:06:10 [auto1.nl] INFO: Saving data for GZ47828: {'created_time': 1774872370.568775, 'last_price_update_time': 1774872370.568787, 'auction_closing_time': 1774971370.0}
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GZ47828') HTTP/1.1" 204 0
2026-03-30 12:07:07 [scrapy.extensions.logstats] INFO: Crawled 61 pages (at 1 pages/min), scraped 41 items (at 1 items/min)
2026-03-30 12:07:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 12:07:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.797(s), this was the 1st time calling it.
2026-03-30 12:07:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.87120198253286 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:07:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.805(s), this was the 2nd time calling it.
2026-03-30 12:07:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.7136363671959876 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:07:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 403.925(s), this was the 3rd time calling it.
2026-03-30 12:07:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.375588212206933 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.080(s), this was the 1st time calling it.
2026-03-30 12:07:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.985645949682641 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.047(s), this was the 2nd time calling it.
2026-03-30 12:07:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.131813403820249 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK44728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY74168/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK44728> (referer: https://www.auto1.com/v1/car-details-view/JK44728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4430e17-f768-59bd-a832-f5b571eb9b69 with identifier: JK44728
2026-03-30 12:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4430e17-f768-59bd-a832-f5b571eb9b69 with scrape type 1
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_4ad4f393ff3361422cdd19791326d0fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_4ad4f393ff3361422cdd19791326d0fa.jpg not downloaded yet
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_4dc6ae6f8f28205be76f801e2d6522bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_4dc6ae6f8f28205be76f801e2d6522bc.jpg not downloaded yet
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_d4a352a925e7c51fd4af44fcf5dc2057.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_d4a352a925e7c51fd4af44fcf5dc2057.jpg not downloaded yet
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_489347fc21ad576a79e344533188d7fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_489347fc21ad576a79e344533188d7fc.jpg not downloaded yet
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_3153ca56b9c4cbd1b638bfc00597518f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_3153ca56b9c4cbd1b638bfc00597518f.jpg not downloaded yet
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_f31eadac3a3304c6ff253c3b5dc4625e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_f31eadac3a3304c6ff253c3b5dc4625e.jpg not downloaded yet
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_d3b2abe86772e478d79718541b04abb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_d3b2abe86772e478d79718541b04abb9.jpg not downloaded yet
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_2017b31ced02bbd0f94b69d58753f848.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_2017b31ced02bbd0f94b69d58753f848.jpg not downloaded yet
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_f4d3f9027e9d8a85b7d4aee4544099a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_f4d3f9027e9d8a85b7d4aee4544099a0.jpg not downloaded yet
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_87390cbb196470c0c960d275c1af7ff0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_87390cbb196470c0c960d275c1af7ff0.jpg not downloaded yet
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_4dc6ae6f8f28205be76f801e2d6522bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_4ad4f393ff3361422cdd19791326d0fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_489347fc21ad576a79e344533188d7fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_f31eadac3a3304c6ff253c3b5dc4625e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_d4a352a925e7c51fd4af44fcf5dc2057.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_f4d3f9027e9d8a85b7d4aee4544099a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_87390cbb196470c0c960d275c1af7ff0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed24d10>
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_4dc6ae6f8f28205be76f801e2d6522bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_4dc6ae6f8f28205be76f801e2d6522bc.jpg saved to cache
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_2017b31ced02bbd0f94b69d58753f848.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed75890>
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_4ad4f393ff3361422cdd19791326d0fa.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_4ad4f393ff3361422cdd19791326d0fa.jpg saved to cache
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7410cf50>
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_489347fc21ad576a79e344533188d7fc.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_489347fc21ad576a79e344533188d7fc.jpg saved to cache
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f752b90>
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_f31eadac3a3304c6ff253c3b5dc4625e.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_f31eadac3a3304c6ff253c3b5dc4625e.jpg saved to cache
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f74f4d0>
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_d4a352a925e7c51fd4af44fcf5dc2057.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_d4a352a925e7c51fd4af44fcf5dc2057.jpg saved to cache
2026-03-30 12:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7527d0>
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_f4d3f9027e9d8a85b7d4aee4544099a0.jpg') HTTP/1.1" 204 0
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_f4d3f9027e9d8a85b7d4aee4544099a0.jpg saved to cache
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_d3b2abe86772e478d79718541b04abb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_3153ca56b9c4cbd1b638bfc00597518f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eea4950>
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_87390cbb196470c0c960d275c1af7ff0.jpg') HTTP/1.1" 204 0
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_87390cbb196470c0c960d275c1af7ff0.jpg saved to cache
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eef5290>
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_2017b31ced02bbd0f94b69d58753f848.jpg') HTTP/1.1" 204 0
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_2017b31ced02bbd0f94b69d58753f848.jpg saved to cache
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eec64d0>
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_d3b2abe86772e478d79718541b04abb9.jpg') HTTP/1.1" 204 0
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_d3b2abe86772e478d79718541b04abb9.jpg saved to cache
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed17510>
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fad%252F57ad0a7a7536c8ec9deb0e1996be403f%252Fpa%252FJK44728_3153ca56b9c4cbd1b638bfc00597518f.jpg') HTTP/1.1" 204 0
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_3153ca56b9c4cbd1b638bfc00597518f.jpg saved to cache
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4430e17-f768-59bd-a832-f5b571eb9b69
2026-03-30 12:08:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4430e17-f768-59bd-a832-f5b571eb9b69, skipping ID generation
2026-03-30 12:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4430e17-f768-59bd-a832-f5b571eb9b69 with scrape type 1
2026-03-30 12:08:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4430e17-f768-59bd-a832-f5b571eb9b69 sending to next pipeline
2026-03-30 12:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d4430e17-f768-59bd-a832-f5b571eb9b69, identifier: JK44728
2026-03-30 12:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d4430e17-f768-59bd-a832-f5b571eb9b69 with identifier: JK44728
2026-03-30 12:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d4430e17-f768-59bd-a832-f5b571eb9b69 with identifier: JK44728
2026-03-30 12:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d4430e17-f768-59bd-a832-f5b571eb9b69 with identifier: JK44728 to the API
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_3153ca56b9c4cbd1b638bfc00597518f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 203,
 'expiration_date': '2026-03-31T15:35:09Z',
 'fuel_type': 'hybrid',
 'id': 'd4430e17-f768-59bd-a832-f5b571eb9b69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '5SNH48',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK44728',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 176101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_4ad4f393ff3361422cdd19791326d0fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_4dc6ae6f8f28205be76f801e2d6522bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_d4a352a925e7c51fd4af44fcf5dc2057.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_489347fc21ad576a79e344533188d7fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_3153ca56b9c4cbd1b638bfc00597518f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_f31eadac3a3304c6ff253c3b5dc4625e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_d3b2abe86772e478d79718541b04abb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_2017b31ced02bbd0f94b69d58753f848.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_f4d3f9027e9d8a85b7d4aee4544099a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4430e17-f768-59bd-a832-f5b571eb9b69/d4430e17-f768-59bd-a832-f5b571eb9b69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/ad/57ad0a7a7536c8ec9deb0e1996be403f/pa/JK44728_87390cbb196470c0c960d275c1af7ff0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Instyle 4WD',
 'year': 2013}
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK44728%27 HTTP/1.1" 200 None
2026-03-30 12:08:00 [auto1.nl] INFO: Saving data for JK44728: {'created_time': 1774872480.762443, 'last_price_update_time': 1774872480.762456, 'auction_closing_time': 1774971309.0}
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK44728') HTTP/1.1" 204 0
2026-03-30 12:08:07 [scrapy.extensions.logstats] INFO: Crawled 64 pages (at 3 pages/min), scraped 42 items (at 1 items/min)
2026-03-30 12:08:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 12:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:13 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 1025 | hits on page: 40
2026-03-30 12:08:13 [auto1.nl] INFO: Found listing with ID: DG65388
2026-03-30 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG65388%27 HTTP/1.1" 200 None
2026-03-30 12:08:13 [auto1.nl] INFO: Scrape type for DG65388: 0
2026-03-30 12:08:13 [auto1.nl] INFO: Found listing with ID: XV56308
2026-03-30 12:08:13 [auto1.nl] INFO: Found listing with ID: LL79212
2026-03-30 12:08:13 [auto1.nl] INFO: Found listing with ID: HZ15227
2026-03-30 12:08:13 [auto1.nl] INFO: Found listing with ID: WY41439
2026-03-30 12:08:13 [auto1.nl] INFO: Found listing with ID: VE97285
2026-03-30 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE97285%27 HTTP/1.1" 200 None
2026-03-30 12:08:13 [auto1.nl] INFO: Scrape type for VE97285: 1
2026-03-30 12:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:13 [auto1.nl] INFO: Found listing with ID: PL69389
2026-03-30 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL69389%27 HTTP/1.1" 200 None
2026-03-30 12:08:13 [auto1.nl] INFO: Scrape type for PL69389: 1
2026-03-30 12:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:13 [auto1.nl] INFO: Found listing with ID: RZ24490
2026-03-30 12:08:13 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-30 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX60140%27 HTTP/1.1" 200 None
2026-03-30 12:08:13 [auto1.nl] INFO: Scrape type for DX60140: 2
2026-03-30 12:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad70305c-15ff-5e57-89a1-d6adb0704c86 with identifier: DX60140
2026-03-30 12:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad70305c-15ff-5e57-89a1-d6adb0704c86 with scrape type 2
2026-03-30 12:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad70305c-15ff-5e57-89a1-d6adb0704c86 with scrape type 2
2026-03-30 12:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad70305c-15ff-5e57-89a1-d6adb0704c86, identifier: DX60140
2026-03-30 12:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad70305c-15ff-5e57-89a1-d6adb0704c86 with identifier: DX60140
2026-03-30 12:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad70305c-15ff-5e57-89a1-d6adb0704c86 with identifier: DX60140
2026-03-30 12:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad70305c-15ff-5e57-89a1-d6adb0704c86 with identifier: DX60140 to the API
2026-03-30 12:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:23:48Z',
 'fuel_type': 'petrol',
 'id': 'ad70305c-15ff-5e57-89a1-d6adb0704c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX60140',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 211897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-26',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Innovation Start&Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start&Stop',
 'year': 2017}
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX60140%27 HTTP/1.1" 200 None
2026-03-30 12:08:14 [auto1.nl] INFO: Saving data for DX60140: {'auction_closing_time': 1774970628.0, 'created_time': 1773132078.272172, 'last_price_update_time': 1774872494.233208}
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DX60140') HTTP/1.1" 204 0
2026-03-30 12:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:14 [auto1.nl] INFO: Found listing with ID: HH64260
2026-03-30 12:08:14 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD46513%27 HTTP/1.1" 200 None
2026-03-30 12:08:14 [auto1.nl] INFO: Scrape type for GD46513: 2
2026-03-30 12:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9023859c-7804-5c43-a201-505fe60481d7 with identifier: GD46513
2026-03-30 12:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9023859c-7804-5c43-a201-505fe60481d7 with scrape type 2
2026-03-30 12:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9023859c-7804-5c43-a201-505fe60481d7 with scrape type 2
2026-03-30 12:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9023859c-7804-5c43-a201-505fe60481d7, identifier: GD46513
2026-03-30 12:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9023859c-7804-5c43-a201-505fe60481d7 with identifier: GD46513
2026-03-30 12:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9023859c-7804-5c43-a201-505fe60481d7 with identifier: GD46513
2026-03-30 12:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9023859c-7804-5c43-a201-505fe60481d7 with identifier: GD46513 to the API
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:51:15Z',
 'fuel_type': 'diesel',
 'id': '9023859c-7804-5c43-a201-505fe60481d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD46513',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 273288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-21',
 'seller_name': None,
 'title': 'BMW X3 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD46513%27 HTTP/1.1" 200 None
2026-03-30 12:08:14 [auto1.nl] INFO: Saving data for GD46513: {'auction_closing_time': 1774972275.0, 'created_time': 1773134377.88392, 'last_price_update_time': 1774872494.695695}
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD46513') HTTP/1.1" 204 0
2026-03-30 12:08:14 [auto1.nl] INFO: Found listing with ID: TH23479
2026-03-30 12:08:14 [auto1.nl] INFO: Found listing with ID: TF99899
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF99899%27 HTTP/1.1" 200 None
2026-03-30 12:08:14 [auto1.nl] INFO: Scrape type for TF99899: 2
2026-03-30 12:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a35c7c26-5221-5c18-84ed-782c2373ac40 with identifier: TF99899
2026-03-30 12:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a35c7c26-5221-5c18-84ed-782c2373ac40 with scrape type 2
2026-03-30 12:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a35c7c26-5221-5c18-84ed-782c2373ac40 with scrape type 2
2026-03-30 12:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a35c7c26-5221-5c18-84ed-782c2373ac40, identifier: TF99899
2026-03-30 12:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a35c7c26-5221-5c18-84ed-782c2373ac40 with identifier: TF99899
2026-03-30 12:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a35c7c26-5221-5c18-84ed-782c2373ac40 with identifier: TF99899
2026-03-30 12:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a35c7c26-5221-5c18-84ed-782c2373ac40 with identifier: TF99899 to the API
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:36:27Z',
 'fuel_type': 'diesel',
 'id': 'a35c7c26-5221-5c18-84ed-782c2373ac40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF99899',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 173230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-01',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2010}
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF99899%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Saving data for TF99899: {'auction_closing_time': 1774971387.0, 'created_time': 1773688325.591284, 'last_price_update_time': 1774872495.264214}
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TF99899') HTTP/1.1" 204 0
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: WA26878
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: XA68110
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA68110%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for XA68110: 1
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: VX45692
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV35318%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for DV35318: 2
2026-03-30 12:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e8853b-e548-54d2-8665-a121fa7d131d with identifier: DV35318
2026-03-30 12:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e8853b-e548-54d2-8665-a121fa7d131d with scrape type 2
2026-03-30 12:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e8853b-e548-54d2-8665-a121fa7d131d with scrape type 2
2026-03-30 12:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 41e8853b-e548-54d2-8665-a121fa7d131d, identifier: DV35318
2026-03-30 12:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 41e8853b-e548-54d2-8665-a121fa7d131d with identifier: DV35318
2026-03-30 12:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 41e8853b-e548-54d2-8665-a121fa7d131d with identifier: DV35318
2026-03-30 12:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 41e8853b-e548-54d2-8665-a121fa7d131d with identifier: DV35318 to the API
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:06Z',
 'fuel_type': 'petrol',
 'id': '41e8853b-e548-54d2-8665-a121fa7d131d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV35318',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 72508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-08',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV35318%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Saving data for DV35318: {'auction_closing_time': 1774971786.0, 'created_time': 1773134425.158354, 'last_price_update_time': 1774872495.797907}
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DV35318') HTTP/1.1" 204 0
2026-03-30 12:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: MN29097
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN29097%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for MN29097: 1
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: VH66359
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH66359%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for VH66359: 1
2026-03-30 12:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: VH78180
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: DT78754
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: LV75014
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LV75014%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for LV75014: 1
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: YT28903
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT28903%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for YT28903: 1
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: JJ19823
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: UU09064
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: RD99814
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD99814%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for RD99814: 1
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: KE17571
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE17571%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for KE17571: 1
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: LN49796
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN49796%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for LN49796: 1
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: GC49424
2026-03-30 12:08:15 [auto1.nl] INFO: Found listing with ID: ZH14552
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZH14552%27 HTTP/1.1" 200 None
2026-03-30 12:08:15 [auto1.nl] INFO: Scrape type for ZH14552: 2
2026-03-30 12:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b248f07-219f-593f-8dec-45b1178528e3 with identifier: ZH14552
2026-03-30 12:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b248f07-219f-593f-8dec-45b1178528e3 with scrape type 2
2026-03-30 12:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b248f07-219f-593f-8dec-45b1178528e3 with scrape type 2
2026-03-30 12:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b248f07-219f-593f-8dec-45b1178528e3, identifier: ZH14552
2026-03-30 12:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b248f07-219f-593f-8dec-45b1178528e3 with identifier: ZH14552
2026-03-30 12:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b248f07-219f-593f-8dec-45b1178528e3 with identifier: ZH14552
2026-03-30 12:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b248f07-219f-593f-8dec-45b1178528e3 with identifier: ZH14552 to the API
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:49:03Z',
 'fuel_type': 'petrol',
 'id': '8b248f07-219f-593f-8dec-45b1178528e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH14552',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 206226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-24',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 GDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZH14552%27 HTTP/1.1" 200 None
2026-03-30 12:08:16 [auto1.nl] INFO: Saving data for ZH14552: {'auction_closing_time': 1774972143.0, 'created_time': 1773514964.138417, 'last_price_update_time': 1774872496.408208}
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZH14552') HTTP/1.1" 204 0
2026-03-30 12:08:16 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-30 12:08:16 [auto1.nl] INFO: Found listing with ID: BU60882
2026-03-30 12:08:16 [auto1.nl] INFO: Found listing with ID: FZ71545
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ71545%27 HTTP/1.1" 200 None
2026-03-30 12:08:16 [auto1.nl] INFO: Scrape type for FZ71545: 1
2026-03-30 12:08:16 [auto1.nl] INFO: Found listing with ID: AJ76364
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ76364%27 HTTP/1.1" 200 None
2026-03-30 12:08:16 [auto1.nl] INFO: Scrape type for AJ76364: 2
2026-03-30 12:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8deca2d7-4a77-5303-b846-900ad6141f7e with identifier: AJ76364
2026-03-30 12:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8deca2d7-4a77-5303-b846-900ad6141f7e with scrape type 2
2026-03-30 12:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8deca2d7-4a77-5303-b846-900ad6141f7e with scrape type 2
2026-03-30 12:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8deca2d7-4a77-5303-b846-900ad6141f7e, identifier: AJ76364
2026-03-30 12:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8deca2d7-4a77-5303-b846-900ad6141f7e with identifier: AJ76364
2026-03-30 12:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8deca2d7-4a77-5303-b846-900ad6141f7e with identifier: AJ76364
2026-03-30 12:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8deca2d7-4a77-5303-b846-900ad6141f7e with identifier: AJ76364 to the API
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:00:41Z',
 'fuel_type': 'diesel',
 'id': '8deca2d7-4a77-5303-b846-900ad6141f7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ76364',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 324534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-14',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2015}
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ76364%27 HTTP/1.1" 200 None
2026-03-30 12:08:16 [auto1.nl] INFO: Saving data for AJ76364: {'auction_closing_time': 1774969241.0, 'created_time': 1774292557.120123, 'last_price_update_time': 1774872496.987515}
2026-03-30 12:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AJ76364') HTTP/1.1" 204 0
2026-03-30 12:08:17 [auto1.nl] INFO: Found listing with ID: LY70010
2026-03-30 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY70010%27 HTTP/1.1" 200 None
2026-03-30 12:08:17 [auto1.nl] INFO: Scrape type for LY70010: 1
2026-03-30 12:08:17 [auto1.nl] INFO: Found listing with ID: SB41881
2026-03-30 12:08:17 [auto1.nl] INFO: Found listing with ID: LC34578
2026-03-30 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC34578%27 HTTP/1.1" 200 None
2026-03-30 12:08:17 [auto1.nl] INFO: Scrape type for LC34578: 1
2026-03-30 12:08:17 [auto1.nl] INFO: Found listing with ID: GA01556
2026-03-30 12:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA68110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN29097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH66359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE97285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD99814/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV75014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:07 [scrapy.extensions.logstats] INFO: Crawled 71 pages (at 7 pages/min), scraped 48 items (at 6 items/min)
2026-03-30 12:09:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 12:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN49796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ71545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT28903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY70010/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:24 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 1025 | hits on page: 40
2026-03-30 12:09:24 [auto1.nl] INFO: Found listing with ID: LU56377
2026-03-30 12:09:24 [auto1.nl] INFO: Found listing with ID: AB98893
2026-03-30 12:09:24 [auto1.nl] INFO: Found listing with ID: JP46089
2026-03-30 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP46089%27 HTTP/1.1" 200 None
2026-03-30 12:09:24 [auto1.nl] INFO: Scrape type for JP46089: 2
2026-03-30 12:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675a7133-17c8-5034-801d-393cdf273272 with identifier: JP46089
2026-03-30 12:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675a7133-17c8-5034-801d-393cdf273272 with scrape type 2
2026-03-30 12:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675a7133-17c8-5034-801d-393cdf273272 with scrape type 2
2026-03-30 12:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 675a7133-17c8-5034-801d-393cdf273272, identifier: JP46089
2026-03-30 12:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 675a7133-17c8-5034-801d-393cdf273272 with identifier: JP46089
2026-03-30 12:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 675a7133-17c8-5034-801d-393cdf273272 with identifier: JP46089
2026-03-30 12:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 675a7133-17c8-5034-801d-393cdf273272 with identifier: JP46089 to the API
2026-03-30 12:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:53:29Z',
 'fuel_type': 'diesel',
 'id': '675a7133-17c8-5034-801d-393cdf273272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP46089',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Shuttle',
 'odometer': 230859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-23',
 'seller_name': None,
 'title': 'Volkswagen T5 Shuttle 2.5 TDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2005}
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP46089%27 HTTP/1.1" 200 None
2026-03-30 12:09:25 [auto1.nl] INFO: Saving data for JP46089: {'auction_closing_time': 1774972409.0, 'created_time': 1773687711.917784, 'last_price_update_time': 1774872565.082326}
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JP46089') HTTP/1.1" 204 0
2026-03-30 12:09:25 [auto1.nl] INFO: Found listing with ID: ZR70834
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR70834%27 HTTP/1.1" 200 None
2026-03-30 12:09:25 [auto1.nl] INFO: Scrape type for ZR70834: 1
2026-03-30 12:09:25 [auto1.nl] INFO: Found listing with ID: FF84926
2026-03-30 12:09:25 [auto1.nl] INFO: Found listing with ID: EH68093
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH68093%27 HTTP/1.1" 200 None
2026-03-30 12:09:25 [auto1.nl] INFO: Scrape type for EH68093: 1
2026-03-30 12:09:25 [auto1.nl] INFO: Found listing with ID: EM83384
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM83384%27 HTTP/1.1" 200 None
2026-03-30 12:09:25 [auto1.nl] INFO: Scrape type for EM83384: 1
2026-03-30 12:09:25 [auto1.nl] INFO: Found listing with ID: CS80457
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS80457%27 HTTP/1.1" 200 None
2026-03-30 12:09:25 [auto1.nl] INFO: Scrape type for CS80457: 1
2026-03-30 12:09:25 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-30 12:09:25 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA08041%27 HTTP/1.1" 200 None
2026-03-30 12:09:25 [auto1.nl] INFO: Scrape type for LA08041: 2
2026-03-30 12:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 409cdecd-8e73-5819-8f28-343ab470082c with identifier: LA08041
2026-03-30 12:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409cdecd-8e73-5819-8f28-343ab470082c with scrape type 2
2026-03-30 12:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 409cdecd-8e73-5819-8f28-343ab470082c with scrape type 2
2026-03-30 12:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 409cdecd-8e73-5819-8f28-343ab470082c, identifier: LA08041
2026-03-30 12:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 409cdecd-8e73-5819-8f28-343ab470082c with identifier: LA08041
2026-03-30 12:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 409cdecd-8e73-5819-8f28-343ab470082c with identifier: LA08041
2026-03-30 12:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 409cdecd-8e73-5819-8f28-343ab470082c with identifier: LA08041 to the API
2026-03-30 12:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:05:37Z',
 'fuel_type': 'petrol',
 'id': '409cdecd-8e73-5819-8f28-343ab470082c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA08041',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 167133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2016}
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA08041%27 HTTP/1.1" 200 None
2026-03-30 12:09:26 [auto1.nl] INFO: Saving data for LA08041: {'auction_closing_time': 1774969537.0, 'created_time': 1773132933.011571, 'last_price_update_time': 1774872566.667858}
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA08041') HTTP/1.1" 204 0
2026-03-30 12:09:26 [auto1.nl] INFO: Found listing with ID: HK91106
2026-03-30 12:09:26 [auto1.nl] INFO: Found listing with ID: LW12392
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW12392%27 HTTP/1.1" 200 None
2026-03-30 12:09:26 [auto1.nl] INFO: Scrape type for LW12392: 1
2026-03-30 12:09:26 [auto1.nl] INFO: Found listing with ID: SE40688
2026-03-30 12:09:26 [auto1.nl] INFO: Found listing with ID: EK69349
2026-03-30 12:09:26 [auto1.nl] INFO: Found listing with ID: RB40697
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RB40697%27 HTTP/1.1" 200 None
2026-03-30 12:09:26 [auto1.nl] INFO: Scrape type for RB40697: 1
2026-03-30 12:09:26 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT82599%27 HTTP/1.1" 200 None
2026-03-30 12:09:26 [auto1.nl] INFO: Scrape type for RT82599: 2
2026-03-30 12:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with identifier: RT82599
2026-03-30 12:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with scrape type 2
2026-03-30 12:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with scrape type 2
2026-03-30 12:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2, identifier: RT82599
2026-03-30 12:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with identifier: RT82599
2026-03-30 12:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with identifier: RT82599
2026-03-30 12:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with identifier: RT82599 to the API
2026-03-30 12:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:02:23Z',
 'fuel_type': 'petrol',
 'id': '0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT82599',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 42320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT82599%27 HTTP/1.1" 200 None
2026-03-30 12:09:27 [auto1.nl] INFO: Saving data for RT82599: {'auction_closing_time': 1774969343.0, 'created_time': 1773132696.649105, 'last_price_update_time': 1774872567.140538}
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT82599') HTTP/1.1" 204 0
2026-03-30 12:09:27 [auto1.nl] INFO: Found listing with ID: UT02482
2026-03-30 12:09:27 [auto1.nl] INFO: Found listing with ID: HD80531
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD80531%27 HTTP/1.1" 200 None
2026-03-30 12:09:27 [auto1.nl] INFO: Scrape type for HD80531: 1
2026-03-30 12:09:27 [auto1.nl] INFO: Found listing with ID: CV57323
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV57323%27 HTTP/1.1" 200 None
2026-03-30 12:09:27 [auto1.nl] INFO: Scrape type for CV57323: 1
2026-03-30 12:09:27 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS89953%27 HTTP/1.1" 200 None
2026-03-30 12:09:27 [auto1.nl] INFO: Scrape type for WS89953: 2
2026-03-30 12:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with identifier: WS89953
2026-03-30 12:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with scrape type 2
2026-03-30 12:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with scrape type 2
2026-03-30 12:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3, identifier: WS89953
2026-03-30 12:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with identifier: WS89953
2026-03-30 12:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with identifier: WS89953
2026-03-30 12:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with identifier: WS89953 to the API
2026-03-30 12:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:57:03Z',
 'fuel_type': 'petrol',
 'id': '143f3ec2-92d7-5eb5-8e19-fec91185ecf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS89953',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 185133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS89953%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [auto1.nl] INFO: Saving data for WS89953: {'auction_closing_time': 1774972623.0, 'created_time': 1774094504.99501, 'last_price_update_time': 1774872568.67782}
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS89953') HTTP/1.1" 204 0
2026-03-30 12:09:28 [auto1.nl] INFO: Found listing with ID: JZ86635
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ86635%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [auto1.nl] INFO: Scrape type for JZ86635: 1
2026-03-30 12:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC34578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:28 [auto1.nl] INFO: Found listing with ID: AP42926
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AP42926%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [auto1.nl] INFO: Scrape type for AP42926: 2
2026-03-30 12:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3653b8fb-6e52-5ae8-8d33-782a27fdafca with identifier: AP42926
2026-03-30 12:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3653b8fb-6e52-5ae8-8d33-782a27fdafca with scrape type 2
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3653b8fb-6e52-5ae8-8d33-782a27fdafca with scrape type 2
2026-03-30 12:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3653b8fb-6e52-5ae8-8d33-782a27fdafca, identifier: AP42926
2026-03-30 12:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3653b8fb-6e52-5ae8-8d33-782a27fdafca with identifier: AP42926
2026-03-30 12:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3653b8fb-6e52-5ae8-8d33-782a27fdafca with identifier: AP42926
2026-03-30 12:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3653b8fb-6e52-5ae8-8d33-782a27fdafca with identifier: AP42926 to the API
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:02:33Z',
 'fuel_type': 'diesel',
 'id': '3653b8fb-6e52-5ae8-8d33-782a27fdafca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP42926',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 262479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-21',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AP42926%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [auto1.nl] INFO: Saving data for AP42926: {'auction_closing_time': 1774969353.0, 'created_time': 1773514954.220782, 'last_price_update_time': 1774872569.192738}
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AP42926') HTTP/1.1" 204 0
2026-03-30 12:09:29 [auto1.nl] INFO: Found listing with ID: MM80557
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM80557%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [auto1.nl] INFO: Scrape type for MM80557: 1
2026-03-30 12:09:29 [auto1.nl] INFO: Found listing with ID: NE79175
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NE79175%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [auto1.nl] INFO: Scrape type for NE79175: 1
2026-03-30 12:09:29 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB01407%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [auto1.nl] INFO: Scrape type for KB01407: 2
2026-03-30 12:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e857dcdf-46d7-532f-b4c8-916b86cbc300 with identifier: KB01407
2026-03-30 12:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e857dcdf-46d7-532f-b4c8-916b86cbc300 with scrape type 2
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e857dcdf-46d7-532f-b4c8-916b86cbc300 with scrape type 2
2026-03-30 12:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e857dcdf-46d7-532f-b4c8-916b86cbc300, identifier: KB01407
2026-03-30 12:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e857dcdf-46d7-532f-b4c8-916b86cbc300 with identifier: KB01407
2026-03-30 12:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e857dcdf-46d7-532f-b4c8-916b86cbc300 with identifier: KB01407
2026-03-30 12:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e857dcdf-46d7-532f-b4c8-916b86cbc300 with identifier: KB01407 to the API
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:50:52Z',
 'fuel_type': 'petrol',
 'id': 'e857dcdf-46d7-532f-b4c8-916b86cbc300',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB01407',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 88147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-23',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2021}
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB01407%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [auto1.nl] INFO: Saving data for KB01407: {'auction_closing_time': 1774972252.0, 'created_time': 1774638135.308064, 'last_price_update_time': 1774872569.711891}
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB01407') HTTP/1.1" 204 0
2026-03-30 12:09:29 [auto1.nl] INFO: Found listing with ID: YB99145
2026-03-30 12:09:29 [auto1.nl] INFO: Found listing with ID: KZ62964
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ62964%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [auto1.nl] INFO: Scrape type for KZ62964: 2
2026-03-30 12:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaa558e9-778c-59bd-9f86-9be085315893 with identifier: KZ62964
2026-03-30 12:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaa558e9-778c-59bd-9f86-9be085315893 with scrape type 2
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaa558e9-778c-59bd-9f86-9be085315893 with scrape type 2
2026-03-30 12:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eaa558e9-778c-59bd-9f86-9be085315893, identifier: KZ62964
2026-03-30 12:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eaa558e9-778c-59bd-9f86-9be085315893 with identifier: KZ62964
2026-03-30 12:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eaa558e9-778c-59bd-9f86-9be085315893 with identifier: KZ62964
2026-03-30 12:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eaa558e9-778c-59bd-9f86-9be085315893 with identifier: KZ62964 to the API
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:26:10Z',
 'fuel_type': 'petrol',
 'id': 'eaa558e9-778c-59bd-9f86-9be085315893',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ62964',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 68836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ62964%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [auto1.nl] INFO: Saving data for KZ62964: {'auction_closing_time': 1774970770.0, 'created_time': 1773514948.959017, 'last_price_update_time': 1774872570.327445}
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KZ62964') HTTP/1.1" 204 0
2026-03-30 12:09:30 [auto1.nl] INFO: Found listing with ID: GH07415
2026-03-30 12:09:30 [auto1.nl] INFO: Found listing with ID: US84379
2026-03-30 12:09:30 [auto1.nl] INFO: Found listing with ID: PK33292
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK33292%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [auto1.nl] INFO: Scrape type for PK33292: 2
2026-03-30 12:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 112f6bc6-295b-5760-89cb-415bb4665ef7 with identifier: PK33292
2026-03-30 12:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 112f6bc6-295b-5760-89cb-415bb4665ef7 with scrape type 2
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 112f6bc6-295b-5760-89cb-415bb4665ef7 with scrape type 2
2026-03-30 12:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 112f6bc6-295b-5760-89cb-415bb4665ef7, identifier: PK33292
2026-03-30 12:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 112f6bc6-295b-5760-89cb-415bb4665ef7 with identifier: PK33292
2026-03-30 12:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 112f6bc6-295b-5760-89cb-415bb4665ef7 with identifier: PK33292
2026-03-30 12:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 112f6bc6-295b-5760-89cb-415bb4665ef7 with identifier: PK33292 to the API
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:30:38Z',
 'fuel_type': 'diesel',
 'id': '112f6bc6-295b-5760-89cb-415bb4665ef7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK33292',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 168530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI BlueEfficiency',
 'transmission': 'manual',
 'trim': 'BlueEfficiency',
 'year': 2014}
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK33292%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [auto1.nl] INFO: Saving data for PK33292: {'auction_closing_time': 1774971038.0, 'created_time': 1773687691.962255, 'last_price_update_time': 1774872570.939116}
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PK33292') HTTP/1.1" 204 0
2026-03-30 12:09:30 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA80832%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [auto1.nl] INFO: Scrape type for GA80832: 2
2026-03-30 12:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832
2026-03-30 12:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with scrape type 2
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with scrape type 2
2026-03-30 12:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b28fb79-b976-5d94-ad37-1ad21ed15f92, identifier: GA80832
2026-03-30 12:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832
2026-03-30 12:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832
2026-03-30 12:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832 to the API
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:26:55Z',
 'fuel_type': 'diesel',
 'id': '6b28fb79-b976-5d94-ad37-1ad21ed15f92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA80832',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 134652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-12',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2016}
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA80832%27 HTTP/1.1" 200 None
2026-03-30 12:09:31 [auto1.nl] INFO: Saving data for GA80832: {'auction_closing_time': 1774970815.0, 'created_time': 1774353842.385482, 'last_price_update_time': 1774872571.787475}
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA80832') HTTP/1.1" 204 0
2026-03-30 12:09:31 [auto1.nl] INFO: Found listing with ID: CV55597
2026-03-30 12:09:31 [auto1.nl] INFO: Found listing with ID: ZK45819
2026-03-30 12:09:31 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL46145%27 HTTP/1.1" 200 None
2026-03-30 12:09:31 [auto1.nl] INFO: Scrape type for PL46145: 2
2026-03-30 12:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944f64e1-301c-5d53-b780-b56c5c98a6f6 with identifier: PL46145
2026-03-30 12:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944f64e1-301c-5d53-b780-b56c5c98a6f6 with scrape type 2
2026-03-30 12:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 944f64e1-301c-5d53-b780-b56c5c98a6f6 with scrape type 2
2026-03-30 12:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 944f64e1-301c-5d53-b780-b56c5c98a6f6, identifier: PL46145
2026-03-30 12:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 944f64e1-301c-5d53-b780-b56c5c98a6f6 with identifier: PL46145
2026-03-30 12:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 944f64e1-301c-5d53-b780-b56c5c98a6f6 with identifier: PL46145
2026-03-30 12:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 944f64e1-301c-5d53-b780-b56c5c98a6f6 with identifier: PL46145 to the API
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:20:25Z',
 'fuel_type': 'petrol',
 'id': '944f64e1-301c-5d53-b780-b56c5c98a6f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL46145',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 215118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-06',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2014}
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL46145%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [auto1.nl] INFO: Saving data for PL46145: {'auction_closing_time': 1774970425.0, 'created_time': 1774526464.728842, 'last_price_update_time': 1774872572.690442}
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PL46145') HTTP/1.1" 204 0
2026-03-30 12:09:32 [auto1.nl] INFO: Found listing with ID: PT85838
2026-03-30 12:09:32 [auto1.nl] INFO: Found listing with ID: ST56241
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST56241%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [auto1.nl] INFO: Scrape type for ST56241: 1
2026-03-30 12:09:32 [auto1.nl] INFO: Found listing with ID: ZG81860
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG81860%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [auto1.nl] INFO: Scrape type for ZG81860: 1
2026-03-30 12:09:32 [auto1.nl] INFO: Found listing with ID: YC70915
2026-03-30 12:09:32 [auto1.nl] INFO: Found listing with ID: SD51522
2026-03-30 12:09:32 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV74945%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [auto1.nl] INFO: Scrape type for GV74945: 2
2026-03-30 12:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fc44c0-77cd-575f-9093-fccb033c0131 with identifier: GV74945
2026-03-30 12:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fc44c0-77cd-575f-9093-fccb033c0131 with scrape type 2
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43fc44c0-77cd-575f-9093-fccb033c0131 with scrape type 2
2026-03-30 12:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 43fc44c0-77cd-575f-9093-fccb033c0131, identifier: GV74945
2026-03-30 12:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 43fc44c0-77cd-575f-9093-fccb033c0131 with identifier: GV74945
2026-03-30 12:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 43fc44c0-77cd-575f-9093-fccb033c0131 with identifier: GV74945
2026-03-30 12:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 43fc44c0-77cd-575f-9093-fccb033c0131 with identifier: GV74945 to the API
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:06:55Z',
 'fuel_type': 'petrol',
 'id': '43fc44c0-77cd-575f-9093-fccb033c0131',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV74945',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 26384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-06',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV74945%27 HTTP/1.1" 200 None
2026-03-30 12:09:33 [auto1.nl] INFO: Saving data for GV74945: {'auction_closing_time': 1774969615.0, 'created_time': 1774465394.29164, 'last_price_update_time': 1774872573.34913}
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV74945') HTTP/1.1" 204 0
2026-03-30 12:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH66359> (referer: https://www.auto1.com/v1/car-details-view/VH66359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 456e31a7-7e2c-5233-86d6-761e0b85dc32 with identifier: VH66359
2026-03-30 12:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 456e31a7-7e2c-5233-86d6-761e0b85dc32 with scrape type 1
2026-03-30 12:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 456e31a7-7e2c-5233-86d6-761e0b85dc32
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_92793f1af7baaa853e1268afad69124d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_92793f1af7baaa853e1268afad69124d.jpg not downloaded yet
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_93d1d2725158b87df8b05e58d535c5e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_93d1d2725158b87df8b05e58d535c5e7.jpg not downloaded yet
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_1a70ef9a72cc66ac416fc89f80b64ba9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_1a70ef9a72cc66ac416fc89f80b64ba9.jpg not downloaded yet
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_3458443df384a4cce18dd614dc46323a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_3458443df384a4cce18dd614dc46323a.jpg not downloaded yet
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_4023fe24d00d34d7991b8b4ccc4569ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_4023fe24d00d34d7991b8b4ccc4569ea.jpg not downloaded yet
2026-03-30 12:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE97285> (referer: https://www.auto1.com/v1/car-details-view/VE97285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5277239f-8c8d-55e2-9833-2d7acb0a9e5d with identifier: VE97285
2026-03-30 12:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5277239f-8c8d-55e2-9833-2d7acb0a9e5d with scrape type 1
2026-03-30 12:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5277239f-8c8d-55e2-9833-2d7acb0a9e5d
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_4352f2b1ce47204971cc124f872342a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_4352f2b1ce47204971cc124f872342a5.jpg not downloaded yet
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_014631c896b78b990908e183d3ae15a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_014631c896b78b990908e183d3ae15a4.jpg not downloaded yet
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_35987d84c3348b9207a5c540eb758f1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_35987d84c3348b9207a5c540eb758f1b.jpg not downloaded yet
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_e579fe98708cadc6479d4ec7b8f85846.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_e579fe98708cadc6479d4ec7b8f85846.jpg not downloaded yet
2026-03-30 12:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_4023fe24d00d34d7991b8b4ccc4569ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_ee68ba0ea48f9f76e68cfc012a19773f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_ee68ba0ea48f9f76e68cfc012a19773f.jpg not downloaded yet
2026-03-30 12:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed28f90>
2026-03-30 12:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_4023fe24d00d34d7991b8b4ccc4569ea.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_4023fe24d00d34d7991b8b4ccc4569ea.jpg saved to cache
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 456e31a7-7e2c-5233-86d6-761e0b85dc32
2026-03-30 12:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_e579fe98708cadc6479d4ec7b8f85846.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_ee68ba0ea48f9f76e68cfc012a19773f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_35987d84c3348b9207a5c540eb758f1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740dba10>
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_e579fe98708cadc6479d4ec7b8f85846.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_e579fe98708cadc6479d4ec7b8f85846.jpg saved to cache
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5277239f-8c8d-55e2-9833-2d7acb0a9e5d
2026-03-30 12:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_014631c896b78b990908e183d3ae15a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f720450>
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_ee68ba0ea48f9f76e68cfc012a19773f.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_ee68ba0ea48f9f76e68cfc012a19773f.jpg saved to cache
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5277239f-8c8d-55e2-9833-2d7acb0a9e5d
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75936fd0>
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_35987d84c3348b9207a5c540eb758f1b.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_35987d84c3348b9207a5c540eb758f1b.jpg saved to cache
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5277239f-8c8d-55e2-9833-2d7acb0a9e5d
2026-03-30 12:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_4352f2b1ce47204971cc124f872342a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed53fd0>
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_014631c896b78b990908e183d3ae15a4.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_014631c896b78b990908e183d3ae15a4.jpg saved to cache
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5277239f-8c8d-55e2-9833-2d7acb0a9e5d
2026-03-30 12:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_3458443df384a4cce18dd614dc46323a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_1a70ef9a72cc66ac416fc89f80b64ba9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a4850>
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fec%252F3cec749d42f115fbf64f93854d5e7493%252Fpa%252FVE97285_4352f2b1ce47204971cc124f872342a5.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_4352f2b1ce47204971cc124f872342a5.jpg saved to cache
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5277239f-8c8d-55e2-9833-2d7acb0a9e5d
2026-03-30 12:09:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5277239f-8c8d-55e2-9833-2d7acb0a9e5d, skipping ID generation
2026-03-30 12:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5277239f-8c8d-55e2-9833-2d7acb0a9e5d with scrape type 1
2026-03-30 12:09:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5277239f-8c8d-55e2-9833-2d7acb0a9e5d sending to next pipeline
2026-03-30 12:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5277239f-8c8d-55e2-9833-2d7acb0a9e5d, identifier: VE97285
2026-03-30 12:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5277239f-8c8d-55e2-9833-2d7acb0a9e5d with identifier: VE97285
2026-03-30 12:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5277239f-8c8d-55e2-9833-2d7acb0a9e5d with identifier: VE97285
2026-03-30 12:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5277239f-8c8d-55e2-9833-2d7acb0a9e5d with identifier: VE97285 to the API
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_4352f2b1ce47204971cc124f872342a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:43:45Z',
 'fuel_type': 'diesel',
 'id': '5277239f-8c8d-55e2-9833-2d7acb0a9e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '39PDF5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE97285',
 'listing': 'auction',
 'location': 'NL, Den Bosch',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 213904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_4352f2b1ce47204971cc124f872342a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_014631c896b78b990908e183d3ae15a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_35987d84c3348b9207a5c540eb758f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_e579fe98708cadc6479d4ec7b8f85846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5277239f-8c8d-55e2-9833-2d7acb0a9e5d/5277239f-8c8d-55e2-9833-2d7acb0a9e5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/ec/3cec749d42f115fbf64f93854d5e7493/pa/VE97285_ee68ba0ea48f9f76e68cfc012a19773f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2011}
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE97285%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [auto1.nl] INFO: Saving data for VE97285: {'created_time': 1774872577.052155, 'last_price_update_time': 1774872577.052168, 'auction_closing_time': 1774971825.0}
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VE97285') HTTP/1.1" 204 0
2026-03-30 12:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_93d1d2725158b87df8b05e58d535c5e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD99814> (referer: https://www.auto1.com/v1/car-details-view/RD99814/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed81250>
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_3458443df384a4cce18dd614dc46323a.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_3458443df384a4cce18dd614dc46323a.jpg saved to cache
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 456e31a7-7e2c-5233-86d6-761e0b85dc32
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eea6c10>
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_1a70ef9a72cc66ac416fc89f80b64ba9.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_1a70ef9a72cc66ac416fc89f80b64ba9.jpg saved to cache
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 456e31a7-7e2c-5233-86d6-761e0b85dc32
2026-03-30 12:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee1bad0>
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_93d1d2725158b87df8b05e58d535c5e7.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_93d1d2725158b87df8b05e58d535c5e7.jpg saved to cache
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 456e31a7-7e2c-5233-86d6-761e0b85dc32
2026-03-30 12:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d651fd-f40e-542e-a51b-70669b5aace5 with identifier: RD99814
2026-03-30 12:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d651fd-f40e-542e-a51b-70669b5aace5 with scrape type 1
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67d651fd-f40e-542e-a51b-70669b5aace5
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_5033cbea8c239a1d37e86b9e7fae7ae4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5033cbea8c239a1d37e86b9e7fae7ae4.jpg already downloaded
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg already downloaded
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_c90ad227d816ab77dc44601bc53841d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_c90ad227d816ab77dc44601bc53841d0.jpg already downloaded
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg already downloaded
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg already downloaded
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_5095648057ea9c5932d475322f7e914f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5095648057ea9c5932d475322f7e914f.jpg already downloaded
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_7520498530dede93d9186f2e2c6fa280.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_7520498530dede93d9186f2e2c6fa280.jpg already downloaded
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_9e1600f1acc61d1fc596c0c62c6568bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_9e1600f1acc61d1fc596c0c62c6568bf.jpg already downloaded
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_6415a33a935137f0c3d8d0ac7394171e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_6415a33a935137f0c3d8d0ac7394171e.jpg already downloaded
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_1f855b1de1b25043bcd49d26d2e5af0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_1f855b1de1b25043bcd49d26d2e5af0b.jpg already downloaded
2026-03-30 12:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 67d651fd-f40e-542e-a51b-70669b5aace5, identifier: RD99814
2026-03-30 12:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 67d651fd-f40e-542e-a51b-70669b5aace5 with identifier: RD99814
2026-03-30 12:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 67d651fd-f40e-542e-a51b-70669b5aace5 with identifier: RD99814
2026-03-30 12:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 67d651fd-f40e-542e-a51b-70669b5aace5 with identifier: RD99814 to the API
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD99814>
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:20:27Z',
 'fuel_type': 'diesel',
 'id': '67d651fd-f40e-542e-a51b-70669b5aace5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TH-782-J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD99814',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 212970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5033cbea8c239a1d37e86b9e7fae7ae4.jpg',
                'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg',
                'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_c90ad227d816ab77dc44601bc53841d0.jpg',
                'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg',
                'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg',
                'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5095648057ea9c5932d475322f7e914f.jpg',
                'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_7520498530dede93d9186f2e2c6fa280.jpg',
                'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_9e1600f1acc61d1fc596c0c62c6568bf.jpg',
                'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_6415a33a935137f0c3d8d0ac7394171e.jpg',
                'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_1f855b1de1b25043bcd49d26d2e5af0b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5033cbea8c239a1d37e86b9e7fae7ae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_c90ad227d816ab77dc44601bc53841d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5095648057ea9c5932d475322f7e914f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_7520498530dede93d9186f2e2c6fa280.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_9e1600f1acc61d1fc596c0c62c6568bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_6415a33a935137f0c3d8d0ac7394171e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_1f855b1de1b25043bcd49d26d2e5af0b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Ambiente',
 'transmission': 'automatic',
 'trim': 'lang Ambiente',
 'year': 2010}
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD99814%27 HTTP/1.1" 200 None
2026-03-30 12:09:37 [auto1.nl] INFO: Saving data for RD99814: {'created_time': 1774872577.852125, 'last_price_update_time': 1774872577.852136, 'auction_closing_time': 1774970427.0}
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD99814') HTTP/1.1" 204 0
2026-03-30 12:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_92793f1af7baaa853e1268afad69124d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb61d0>
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F75%252Fc17579b63e42c8a67f5806f2fed90989%252Fpa%252FVH66359_92793f1af7baaa853e1268afad69124d.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_92793f1af7baaa853e1268afad69124d.jpg saved to cache
2026-03-30 12:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 456e31a7-7e2c-5233-86d6-761e0b85dc32
2026-03-30 12:09:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 456e31a7-7e2c-5233-86d6-761e0b85dc32, skipping ID generation
2026-03-30 12:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 456e31a7-7e2c-5233-86d6-761e0b85dc32 with scrape type 1
2026-03-30 12:09:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 456e31a7-7e2c-5233-86d6-761e0b85dc32 sending to next pipeline
2026-03-30 12:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 456e31a7-7e2c-5233-86d6-761e0b85dc32, identifier: VH66359
2026-03-30 12:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 456e31a7-7e2c-5233-86d6-761e0b85dc32 with identifier: VH66359
2026-03-30 12:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 456e31a7-7e2c-5233-86d6-761e0b85dc32 with identifier: VH66359
2026-03-30 12:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 456e31a7-7e2c-5233-86d6-761e0b85dc32 with identifier: VH66359 to the API
2026-03-30 12:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_92793f1af7baaa853e1268afad69124d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:12:09Z',
 'fuel_type': 'petrol',
 'id': '456e31a7-7e2c-5233-86d6-761e0b85dc32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '15HGXP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH66359',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 98492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_92793f1af7baaa853e1268afad69124d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_93d1d2725158b87df8b05e58d535c5e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_1a70ef9a72cc66ac416fc89f80b64ba9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_3458443df384a4cce18dd614dc46323a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_456e31a7-7e2c-5233-86d6-761e0b85dc32/456e31a7-7e2c-5233-86d6-761e0b85dc32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/75/c17579b63e42c8a67f5806f2fed90989/pa/VH66359_4023fe24d00d34d7991b8b4ccc4569ea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.4 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2001}
2026-03-30 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH66359%27 HTTP/1.1" 200 None
2026-03-30 12:09:38 [auto1.nl] INFO: Saving data for VH66359: {'created_time': 1774872578.445116, 'last_price_update_time': 1774872578.445128, 'auction_closing_time': 1774969929.0}
2026-03-30 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH66359') HTTP/1.1" 204 0
2026-03-30 12:09:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.965(s), this was the 2nd time calling it.
2026-03-30 12:09:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.709338243527403 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN29097> (referer: https://www.auto1.com/v1/car-details-view/MN29097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39d87f23-43cb-5c04-bd68-f5531398bf6f with identifier: MN29097
2026-03-30 12:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39d87f23-43cb-5c04-bd68-f5531398bf6f with scrape type 1
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 39d87f23-43cb-5c04-bd68-f5531398bf6f
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F8a%252F688aa888607a3ebbbed76d7ab1de6eef%252Fpa%252FMN29097_44ba811816530ba67257df926899688b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_44ba811816530ba67257df926899688b.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F8a%252F688aa888607a3ebbbed76d7ab1de6eef%252Fpa%252FMN29097_18d1d2b46bb9a539e5f847a67c4a03e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_18d1d2b46bb9a539e5f847a67c4a03e7.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F8a%252F688aa888607a3ebbbed76d7ab1de6eef%252Fpa%252FMN29097_1a59a1a6073e6730bcc46679f5df5fb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_1a59a1a6073e6730bcc46679f5df5fb6.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F8a%252F688aa888607a3ebbbed76d7ab1de6eef%252Fpa%252FMN29097_970fdd3b42f43045fca254e232458484.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_970fdd3b42f43045fca254e232458484.jpg not downloaded yet
2026-03-30 12:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA68110> (referer: https://www.auto1.com/v1/car-details-view/XA68110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_970fdd3b42f43045fca254e232458484.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5487cf2a-6198-50f1-8276-1357027b3ae1 with identifier: XA68110
2026-03-30 12:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5487cf2a-6198-50f1-8276-1357027b3ae1 with scrape type 1
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_99f1b68ca156dd5213d09afcd2ab93fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_99f1b68ca156dd5213d09afcd2ab93fa.jpg not downloaded yet
2026-03-30 12:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_1a59a1a6073e6730bcc46679f5df5fb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_d290c725da35ef3c98cf6cd38b99adf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_d290c725da35ef3c98cf6cd38b99adf0.jpg not downloaded yet
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_244344f283b3e8db0ab26528b36b9550.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_244344f283b3e8db0ab26528b36b9550.jpg not downloaded yet
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_3d02961bdb3e65cf4e8cbbcd7ef0a006.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_3d02961bdb3e65cf4e8cbbcd7ef0a006.jpg not downloaded yet
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_a1bf2e540794427ff179f4d72e87ef53.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_a1bf2e540794427ff179f4d72e87ef53.jpg not downloaded yet
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee52590>
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39d87f23-43cb-5c04-bd68-f5531398bf6f/39d87f23-43cb-5c04-bd68-f5531398bf6f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F8a%252F688aa888607a3ebbbed76d7ab1de6eef%252Fpa%252FMN29097_970fdd3b42f43045fca254e232458484.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_970fdd3b42f43045fca254e232458484.jpg saved to cache
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39d87f23-43cb-5c04-bd68-f5531398bf6f
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_2841530887f7e4871f3c414af2dd509e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_2841530887f7e4871f3c414af2dd509e.jpg not downloaded yet
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_b1583e88f6b4ed38527fb92542ba33e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_b1583e88f6b4ed38527fb92542ba33e4.jpg not downloaded yet
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_9422e4eb010ebbc18c5212a91a745ec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_9422e4eb010ebbc18c5212a91a745ec8.jpg not downloaded yet
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eec6450>
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39d87f23-43cb-5c04-bd68-f5531398bf6f/39d87f23-43cb-5c04-bd68-f5531398bf6f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F8a%252F688aa888607a3ebbbed76d7ab1de6eef%252Fpa%252FMN29097_1a59a1a6073e6730bcc46679f5df5fb6.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_1a59a1a6073e6730bcc46679f5df5fb6.jpg saved to cache
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39d87f23-43cb-5c04-bd68-f5531398bf6f
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_a15c6762d6c037508cc94cf63403b348.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_a15c6762d6c037508cc94cf63403b348.jpg not downloaded yet
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_9fe0ab39770eafb22ee94a489435daed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_9fe0ab39770eafb22ee94a489435daed.jpg not downloaded yet
2026-03-30 12:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_99f1b68ca156dd5213d09afcd2ab93fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:09:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:09:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:09:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a1790>
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_99f1b68ca156dd5213d09afcd2ab93fa.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_99f1b68ca156dd5213d09afcd2ab93fa.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_9fe0ab39770eafb22ee94a489435daed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_a15c6762d6c037508cc94cf63403b348.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_9422e4eb010ebbc18c5212a91a745ec8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f782350>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_9fe0ab39770eafb22ee94a489435daed.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_9fe0ab39770eafb22ee94a489435daed.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_b1583e88f6b4ed38527fb92542ba33e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee50550>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_a15c6762d6c037508cc94cf63403b348.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_a15c6762d6c037508cc94cf63403b348.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74078190>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_9422e4eb010ebbc18c5212a91a745ec8.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_9422e4eb010ebbc18c5212a91a745ec8.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_2841530887f7e4871f3c414af2dd509e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a10d0>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_b1583e88f6b4ed38527fb92542ba33e4.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_b1583e88f6b4ed38527fb92542ba33e4.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_a1bf2e540794427ff179f4d72e87ef53.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_3d02961bdb3e65cf4e8cbbcd7ef0a006.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee51790>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_2841530887f7e4871f3c414af2dd509e.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_2841530887f7e4871f3c414af2dd509e.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_244344f283b3e8db0ab26528b36b9550.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75643e50>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_a1bf2e540794427ff179f4d72e87ef53.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_a1bf2e540794427ff179f4d72e87ef53.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_d290c725da35ef3c98cf6cd38b99adf0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee582d0>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_3d02961bdb3e65cf4e8cbbcd7ef0a006.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_3d02961bdb3e65cf4e8cbbcd7ef0a006.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee883d0>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_244344f283b3e8db0ab26528b36b9550.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_244344f283b3e8db0ab26528b36b9550.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_18d1d2b46bb9a539e5f847a67c4a03e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV75014> (referer: https://www.auto1.com/v1/car-details-view/LV75014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee48750>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F31%252F1231a9a25e5f82b3066d90fa04e56ad6%252Fpa%252FXA68110_d290c725da35ef3c98cf6cd38b99adf0.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_d290c725da35ef3c98cf6cd38b99adf0.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5487cf2a-6198-50f1-8276-1357027b3ae1
2026-03-30 12:09:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5487cf2a-6198-50f1-8276-1357027b3ae1, skipping ID generation
2026-03-30 12:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5487cf2a-6198-50f1-8276-1357027b3ae1 with scrape type 1
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5487cf2a-6198-50f1-8276-1357027b3ae1 sending to next pipeline
2026-03-30 12:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5487cf2a-6198-50f1-8276-1357027b3ae1, identifier: XA68110
2026-03-30 12:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5487cf2a-6198-50f1-8276-1357027b3ae1 with identifier: XA68110
2026-03-30 12:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5487cf2a-6198-50f1-8276-1357027b3ae1 with identifier: XA68110
2026-03-30 12:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5487cf2a-6198-50f1-8276-1357027b3ae1 with identifier: XA68110 to the API
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_d290c725da35ef3c98cf6cd38b99adf0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 221,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:53:45Z',
 'fuel_type': 'petrol',
 'id': '5487cf2a-6198-50f1-8276-1357027b3ae1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA68110',
 'listing': 'auction',
 'location': 'NL',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 163618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5254546,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_99f1b68ca156dd5213d09afcd2ab93fa.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_d290c725da35ef3c98cf6cd38b99adf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_244344f283b3e8db0ab26528b36b9550.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_3d02961bdb3e65cf4e8cbbcd7ef0a006.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_a1bf2e540794427ff179f4d72e87ef53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_2841530887f7e4871f3c414af2dd509e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_b1583e88f6b4ed38527fb92542ba33e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_9422e4eb010ebbc18c5212a91a745ec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_a15c6762d6c037508cc94cf63403b348.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487cf2a-6198-50f1-8276-1357027b3ae1/5487cf2a-6198-50f1-8276-1357027b3ae1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/31/1231a9a25e5f82b3066d90fa04e56ad6/pa/XA68110_9fe0ab39770eafb22ee94a489435daed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-04-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA68110%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [auto1.nl] INFO: Saving data for XA68110: {'created_time': 1774872586.176381, 'last_price_update_time': 1774872586.176391, 'auction_closing_time': 1774972425.0}
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XA68110') HTTP/1.1" 204 0
2026-03-30 12:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_44ba811816530ba67257df926899688b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f777710>
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39d87f23-43cb-5c04-bd68-f5531398bf6f/39d87f23-43cb-5c04-bd68-f5531398bf6f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F8a%252F688aa888607a3ebbbed76d7ab1de6eef%252Fpa%252FMN29097_18d1d2b46bb9a539e5f847a67c4a03e7.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_18d1d2b46bb9a539e5f847a67c4a03e7.jpg saved to cache
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39d87f23-43cb-5c04-bd68-f5531398bf6f
2026-03-30 12:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e8cb10-6f23-5d93-919d-842e83ce3c85 with identifier: LV75014
2026-03-30 12:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e8cb10-6f23-5d93-919d-842e83ce3c85 with scrape type 1
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 46e8cb10-6f23-5d93-919d-842e83ce3c85
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F79%252Fdc79215487a303bab3ca14d44df91621%252Fpa%252FLV75014_9cf441bc1202acd187312fd25553d0fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_9cf441bc1202acd187312fd25553d0fb.jpg already downloaded
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F79%252Fdc79215487a303bab3ca14d44df91621%252Fpa%252FLV75014_ad84a5ddd76d265add46b754a82fe99e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_ad84a5ddd76d265add46b754a82fe99e.jpg already downloaded
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F79%252Fdc79215487a303bab3ca14d44df91621%252Fpa%252FLV75014_29420de872c7b60f1b445980038ae5aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_29420de872c7b60f1b445980038ae5aa.jpg already downloaded
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F79%252Fdc79215487a303bab3ca14d44df91621%252Fpa%252FLV75014_904b67785fe7be0e14be4bdc0122d238.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_904b67785fe7be0e14be4bdc0122d238.jpg already downloaded
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F79%252Fdc79215487a303bab3ca14d44df91621%252Fpa%252FLV75014_da98b7939c030cf90d96dd69a9028510.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_da98b7939c030cf90d96dd69a9028510.jpg already downloaded
2026-03-30 12:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 46e8cb10-6f23-5d93-919d-842e83ce3c85, identifier: LV75014
2026-03-30 12:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 46e8cb10-6f23-5d93-919d-842e83ce3c85 with identifier: LV75014
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 12:09:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 46e8cb10-6f23-5d93-919d-842e83ce3c85 with identifier: LV75014
2026-03-30 12:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 46e8cb10-6f23-5d93-919d-842e83ce3c85 with identifier: LV75014 to the API
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LV75014>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:17:51Z',
 'fuel_type': 'petrol',
 'id': '46e8cb10-6f23-5d93-919d-842e83ce3c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '17RZGS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV75014',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'New Beetle',
 'odometer': 210517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_9cf441bc1202acd187312fd25553d0fb.jpg',
                'https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_ad84a5ddd76d265add46b754a82fe99e.jpg',
                'https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_29420de872c7b60f1b445980038ae5aa.jpg',
                'https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_904b67785fe7be0e14be4bdc0122d238.jpg',
                'https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_da98b7939c030cf90d96dd69a9028510.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8cb10-6f23-5d93-919d-842e83ce3c85/46e8cb10-6f23-5d93-919d-842e83ce3c85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_9cf441bc1202acd187312fd25553d0fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8cb10-6f23-5d93-919d-842e83ce3c85/46e8cb10-6f23-5d93-919d-842e83ce3c85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_ad84a5ddd76d265add46b754a82fe99e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8cb10-6f23-5d93-919d-842e83ce3c85/46e8cb10-6f23-5d93-919d-842e83ce3c85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_29420de872c7b60f1b445980038ae5aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8cb10-6f23-5d93-919d-842e83ce3c85/46e8cb10-6f23-5d93-919d-842e83ce3c85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_904b67785fe7be0e14be4bdc0122d238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8cb10-6f23-5d93-919d-842e83ce3c85/46e8cb10-6f23-5d93-919d-842e83ce3c85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/79/dc79215487a303bab3ca14d44df91621/pa/LV75014_da98b7939c030cf90d96dd69a9028510.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-02-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen New Beetle 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LV75014%27 HTTP/1.1" 200 None
2026-03-30 12:09:46 [auto1.nl] INFO: Saving data for LV75014: {'created_time': 1774872586.95159, 'last_price_update_time': 1774872586.9516, 'auction_closing_time': 1774970271.0}
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LV75014') HTTP/1.1" 204 0
2026-03-30 12:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740d9f90>
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39d87f23-43cb-5c04-bd68-f5531398bf6f/39d87f23-43cb-5c04-bd68-f5531398bf6f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F8a%252F688aa888607a3ebbbed76d7ab1de6eef%252Fpa%252FMN29097_44ba811816530ba67257df926899688b.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_44ba811816530ba67257df926899688b.jpg saved to cache
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39d87f23-43cb-5c04-bd68-f5531398bf6f
2026-03-30 12:09:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39d87f23-43cb-5c04-bd68-f5531398bf6f, skipping ID generation
2026-03-30 12:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39d87f23-43cb-5c04-bd68-f5531398bf6f with scrape type 1
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39d87f23-43cb-5c04-bd68-f5531398bf6f sending to next pipeline
2026-03-30 12:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 39d87f23-43cb-5c04-bd68-f5531398bf6f, identifier: MN29097
2026-03-30 12:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 39d87f23-43cb-5c04-bd68-f5531398bf6f with identifier: MN29097
2026-03-30 12:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 39d87f23-43cb-5c04-bd68-f5531398bf6f with identifier: MN29097
2026-03-30 12:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 39d87f23-43cb-5c04-bd68-f5531398bf6f with identifier: MN29097 to the API
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_44ba811816530ba67257df926899688b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:46:35Z',
 'fuel_type': 'petrol',
 'id': '39d87f23-43cb-5c04-bd68-f5531398bf6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '12JJZ7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN29097',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 213965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39d87f23-43cb-5c04-bd68-f5531398bf6f/39d87f23-43cb-5c04-bd68-f5531398bf6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_44ba811816530ba67257df926899688b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39d87f23-43cb-5c04-bd68-f5531398bf6f/39d87f23-43cb-5c04-bd68-f5531398bf6f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_18d1d2b46bb9a539e5f847a67c4a03e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39d87f23-43cb-5c04-bd68-f5531398bf6f/39d87f23-43cb-5c04-bd68-f5531398bf6f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_1a59a1a6073e6730bcc46679f5df5fb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39d87f23-43cb-5c04-bd68-f5531398bf6f/39d87f23-43cb-5c04-bd68-f5531398bf6f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/8a/688aa888607a3ebbbed76d7ab1de6eef/pa/MN29097_970fdd3b42f43045fca254e232458484.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Bravo 1.4 Turbo T JET Racing',
 'transmission': 'manual',
 'trim': 'T JET Racing',
 'year': 2009}
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN29097%27 HTTP/1.1" 200 None
2026-03-30 12:09:47 [auto1.nl] INFO: Saving data for MN29097: {'created_time': 1774872587.48687, 'last_price_update_time': 1774872587.486885, 'auction_closing_time': 1774971995.0}
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MN29097') HTTP/1.1" 204 0
2026-03-30 12:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN49796> (referer: https://www.auto1.com/v1/car-details-view/LN49796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7 with identifier: LN49796
2026-03-30 12:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7 with scrape type 1
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_2ce3cc607f65e3a76ce92c8e2e7639f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_2ce3cc607f65e3a76ce92c8e2e7639f9.jpg not downloaded yet
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_9a9a6c382e3b728c94b23c276eeb3e56.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_9a9a6c382e3b728c94b23c276eeb3e56.jpg not downloaded yet
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_158a51488c970e3519b58a71661a1f78.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_158a51488c970e3519b58a71661a1f78.jpg not downloaded yet
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_341f785206deb4d80238463b37ecdfd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_341f785206deb4d80238463b37ecdfd4.jpg not downloaded yet
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_98e75d502feb1bc9e2cce22fb88c52f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_98e75d502feb1bc9e2cce22fb88c52f5.jpg not downloaded yet
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_bb2e018c8f1eda9f82572958e6863475.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_bb2e018c8f1eda9f82572958e6863475.jpg not downloaded yet
2026-03-30 12:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA93170> (referer: https://www.auto1.com/v1/car-details-view/PA93170/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_bb2e018c8f1eda9f82572958e6863475.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY70010> (referer: https://www.auto1.com/v1/car-details-view/LY70010/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 732bfc25-45b5-539a-898f-293b06fc2703 with identifier: PA93170
2026-03-30 12:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 732bfc25-45b5-539a-898f-293b06fc2703 with scrape type 1
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 732bfc25-45b5-539a-898f-293b06fc2703
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_806f2183af2b5c27bd448235c16641a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_806f2183af2b5c27bd448235c16641a0.jpg already downloaded
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_0529b716750f2b3ca4023eba2e29a324.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_0529b716750f2b3ca4023eba2e29a324.jpg already downloaded
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_5989be15f25f9a7910a2d7f331e044bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_5989be15f25f9a7910a2d7f331e044bb.jpg already downloaded
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_7ecb4066a2f1d3742cae3bbaa42693c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_7ecb4066a2f1d3742cae3bbaa42693c5.jpg already downloaded
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_790bf375394bf01184fb0d703f9bd288.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_790bf375394bf01184fb0d703f9bd288.jpg already downloaded
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_21fdae657dbf46ce33a59aed559b0212.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_21fdae657dbf46ce33a59aed559b0212.jpg already downloaded
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_d40736ebcdb5ef25f0010a56bd30d3e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_d40736ebcdb5ef25f0010a56bd30d3e9.jpg already downloaded
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_1a7a9e022ed3c2a00c88e7d7d76698ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_1a7a9e022ed3c2a00c88e7d7d76698ac.jpg already downloaded
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_b8f9b3e35fcccaf0df40705bf109cdd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_b8f9b3e35fcccaf0df40705bf109cdd0.jpg already downloaded
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F90%252Ffa902ae2c60398efb84c0308da8395f7%252Fpa%252FPA93170_e91a57f4ce97e634ae1bbce52dca5d46.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_e91a57f4ce97e634ae1bbce52dca5d46.jpg already downloaded
2026-03-30 12:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 732bfc25-45b5-539a-898f-293b06fc2703, identifier: PA93170
2026-03-30 12:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 732bfc25-45b5-539a-898f-293b06fc2703 with identifier: PA93170
2026-03-30 12:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 732bfc25-45b5-539a-898f-293b06fc2703 with identifier: PA93170
2026-03-30 12:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 732bfc25-45b5-539a-898f-293b06fc2703 with identifier: PA93170 to the API
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PA93170>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:01:49Z',
 'fuel_type': 'petrol',
 'id': '732bfc25-45b5-539a-898f-293b06fc2703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P-766-ZG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA93170',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Citroen',
 'model': 'DS3 Cabrio',
 'odometer': 103500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_806f2183af2b5c27bd448235c16641a0.jpg',
                'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_0529b716750f2b3ca4023eba2e29a324.jpg',
                'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_5989be15f25f9a7910a2d7f331e044bb.jpg',
                'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_7ecb4066a2f1d3742cae3bbaa42693c5.jpg',
                'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_790bf375394bf01184fb0d703f9bd288.jpg',
                'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_21fdae657dbf46ce33a59aed559b0212.jpg',
                'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_d40736ebcdb5ef25f0010a56bd30d3e9.jpg',
                'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_1a7a9e022ed3c2a00c88e7d7d76698ac.jpg',
                'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_b8f9b3e35fcccaf0df40705bf109cdd0.jpg',
                'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_e91a57f4ce97e634ae1bbce52dca5d46.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_806f2183af2b5c27bd448235c16641a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_0529b716750f2b3ca4023eba2e29a324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_5989be15f25f9a7910a2d7f331e044bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_7ecb4066a2f1d3742cae3bbaa42693c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_790bf375394bf01184fb0d703f9bd288.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_21fdae657dbf46ce33a59aed559b0212.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_d40736ebcdb5ef25f0010a56bd30d3e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_1a7a9e022ed3c2a00c88e7d7d76698ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_b8f9b3e35fcccaf0df40705bf109cdd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_732bfc25-45b5-539a-898f-293b06fc2703/732bfc25-45b5-539a-898f-293b06fc2703_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/90/fa902ae2c60398efb84c0308da8395f7/pa/PA93170_e91a57f4ce97e634ae1bbce52dca5d46.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen DS3 Cabrio 1.6 VTi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2013}
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA93170%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [auto1.nl] INFO: Saving data for PA93170: {'created_time': 1774872589.790303, 'last_price_update_time': 1774872589.790315, 'auction_closing_time': 1774969309.0}
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA93170') HTTP/1.1" 204 0
2026-03-30 12:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee49710>
2026-03-30 12:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_bb2e018c8f1eda9f82572958e6863475.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_bb2e018c8f1eda9f82572958e6863475.jpg saved to cache
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7
2026-03-30 12:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e6fad2b-06a1-540b-8894-58d9878a7a51 with identifier: LY70010
2026-03-30 12:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e6fad2b-06a1-540b-8894-58d9878a7a51 with scrape type 1
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4e6fad2b-06a1-540b-8894-58d9878a7a51
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_973f0c744f0b7c8b9e8c03308e0ec490.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_973f0c744f0b7c8b9e8c03308e0ec490.jpg not downloaded yet
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_cce501c8126e25fc13831a72adde416b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_cce501c8126e25fc13831a72adde416b.jpg not downloaded yet
2026-03-30 12:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_98e75d502feb1bc9e2cce22fb88c52f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_ae89b9866775495a9f20c3c533f9fde8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_ae89b9866775495a9f20c3c533f9fde8.jpg not downloaded yet
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_4d21b17f73bc5669f82b7ac657e6f9e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_4d21b17f73bc5669f82b7ac657e6f9e6.jpg not downloaded yet
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_e393f5e600910d824de6a167effb5705.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_e393f5e600910d824de6a167effb5705.jpg not downloaded yet
2026-03-30 12:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_cce501c8126e25fc13831a72adde416b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74098950>
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_98e75d502feb1bc9e2cce22fb88c52f5.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_98e75d502feb1bc9e2cce22fb88c52f5.jpg saved to cache
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7
2026-03-30 12:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_e393f5e600910d824de6a167effb5705.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed51190>
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_cce501c8126e25fc13831a72adde416b.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_cce501c8126e25fc13831a72adde416b.jpg saved to cache
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e6fad2b-06a1-540b-8894-58d9878a7a51
2026-03-30 12:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_341f785206deb4d80238463b37ecdfd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_4d21b17f73bc5669f82b7ac657e6f9e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_ae89b9866775495a9f20c3c533f9fde8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed7ecd0>
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_e393f5e600910d824de6a167effb5705.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_e393f5e600910d824de6a167effb5705.jpg saved to cache
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e6fad2b-06a1-540b-8894-58d9878a7a51
2026-03-30 12:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_973f0c744f0b7c8b9e8c03308e0ec490.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee19cd0>
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_341f785206deb4d80238463b37ecdfd4.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_341f785206deb4d80238463b37ecdfd4.jpg saved to cache
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7
2026-03-30 12:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_158a51488c970e3519b58a71661a1f78.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74069450>
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_4d21b17f73bc5669f82b7ac657e6f9e6.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_4d21b17f73bc5669f82b7ac657e6f9e6.jpg saved to cache
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e6fad2b-06a1-540b-8894-58d9878a7a51
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740f1d50>
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_ae89b9866775495a9f20c3c533f9fde8.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_ae89b9866775495a9f20c3c533f9fde8.jpg saved to cache
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e6fad2b-06a1-540b-8894-58d9878a7a51
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed77f10>
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F12%252Fb2122eaaee9d75fe7b04d4212c34902a%252Fpa%252FLY70010_973f0c744f0b7c8b9e8c03308e0ec490.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_973f0c744f0b7c8b9e8c03308e0ec490.jpg saved to cache
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e6fad2b-06a1-540b-8894-58d9878a7a51
2026-03-30 12:09:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e6fad2b-06a1-540b-8894-58d9878a7a51, skipping ID generation
2026-03-30 12:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e6fad2b-06a1-540b-8894-58d9878a7a51 with scrape type 1
2026-03-30 12:09:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e6fad2b-06a1-540b-8894-58d9878a7a51 sending to next pipeline
2026-03-30 12:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4e6fad2b-06a1-540b-8894-58d9878a7a51, identifier: LY70010
2026-03-30 12:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4e6fad2b-06a1-540b-8894-58d9878a7a51 with identifier: LY70010
2026-03-30 12:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4e6fad2b-06a1-540b-8894-58d9878a7a51 with identifier: LY70010
2026-03-30 12:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4e6fad2b-06a1-540b-8894-58d9878a7a51 with identifier: LY70010 to the API
2026-03-30 12:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_973f0c744f0b7c8b9e8c03308e0ec490.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 2',
 'engine': '1.8L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:00:44Z',
 'fuel_type': 'petrol',
 'id': '4e6fad2b-06a1-540b-8894-58d9878a7a51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '84ZSHF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY70010',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 272183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_973f0c744f0b7c8b9e8c03308e0ec490.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_cce501c8126e25fc13831a72adde416b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_ae89b9866775495a9f20c3c533f9fde8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_4d21b17f73bc5669f82b7ac657e6f9e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e6fad2b-06a1-540b-8894-58d9878a7a51/4e6fad2b-06a1-540b-8894-58d9878a7a51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/12/b2122eaaee9d75fe7b04d4212c34902a/pa/LY70010_e393f5e600910d824de6a167effb5705.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-02-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 1.8 Turbo Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 1999}
2026-03-30 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY70010%27 HTTP/1.1" 200 None
2026-03-30 12:09:51 [auto1.nl] INFO: Saving data for LY70010: {'created_time': 1774872591.938646, 'last_price_update_time': 1774872591.938658, 'auction_closing_time': 1774969244.0}
2026-03-30 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LY70010') HTTP/1.1" 204 0
2026-03-30 12:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_9a9a6c382e3b728c94b23c276eeb3e56.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ86635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a41d0>
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_158a51488c970e3519b58a71661a1f78.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_158a51488c970e3519b58a71661a1f78.jpg saved to cache
2026-03-30 12:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7
2026-03-30 12:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_2ce3cc607f65e3a76ce92c8e2e7639f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee07cd0>
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_9a9a6c382e3b728c94b23c276eeb3e56.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_9a9a6c382e3b728c94b23c276eeb3e56.jpg saved to cache
2026-03-30 12:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f75f090>
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F80%252Fce80970b4fe111a51e87fd53290122ff%252Fpa%252FLN49796_2ce3cc607f65e3a76ce92c8e2e7639f9.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_2ce3cc607f65e3a76ce92c8e2e7639f9.jpg saved to cache
2026-03-30 12:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7
2026-03-30 12:09:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7, skipping ID generation
2026-03-30 12:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7 with scrape type 1
2026-03-30 12:09:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7 sending to next pipeline
2026-03-30 12:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7, identifier: LN49796
2026-03-30 12:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7 with identifier: LN49796
2026-03-30 12:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7 with identifier: LN49796
2026-03-30 12:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7 with identifier: LN49796 to the API
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_2ce3cc607f65e3a76ce92c8e2e7639f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:06:13Z',
 'fuel_type': 'electro',
 'id': 'c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN49796',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Cupra',
 'model': 'Born',
 'odometer': 93694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367716,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_2ce3cc607f65e3a76ce92c8e2e7639f9.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334215,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_9a9a6c382e3b728c94b23c276eeb3e56.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376422,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_158a51488c970e3519b58a71661a1f78.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264608,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_341f785206deb4d80238463b37ecdfd4.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297471,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_98e75d502feb1bc9e2cce22fb88c52f5.jpg',
             'Width': 1365},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7/c3e4e791-e38e-5cbd-8af0-e90a9a3bdbb7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333724,
             'Height': 1024,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/80/ce80970b4fe111a51e87fd53290122ff/pa/LN49796_bb2e018c8f1eda9f82572958e6863475.jpg',
             'Width': 1365}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Born electric drive 150 kW',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN49796%27 HTTP/1.1" 200 None
2026-03-30 12:09:52 [auto1.nl] INFO: Saving data for LN49796: {'created_time': 1774872592.821388, 'last_price_update_time': 1774872592.821398, 'auction_closing_time': 1774969573.0}
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LN49796') HTTP/1.1" 204 0
2026-03-30 12:10:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 402.215(s), this was the 3rd time calling it.
2026-03-30 12:10:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.9065946347771 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:10:07 [scrapy.extensions.logstats] INFO: Crawled 87 pages (at 16 pages/min), scraped 68 items (at 20 items/min)
2026-03-30 12:10:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 12:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE17571/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.015(s), this was the 1st time calling it.
2026-03-30 12:10:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.246601495410585 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT28903> (referer: https://www.auto1.com/v1/car-details-view/YT28903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b70fa3ea-1f12-5826-8109-05c4e4aa34f1 with identifier: YT28903
2026-03-30 12:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70fa3ea-1f12-5826-8109-05c4e4aa34f1 with scrape type 1
2026-03-30 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b70fa3ea-1f12-5826-8109-05c4e4aa34f1
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F35%252F153540e8a552682eba2184291b5b6490%252Fpa%252FYT28903_22cf7c9497e1aabb1e0cfe6d798d22a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_22cf7c9497e1aabb1e0cfe6d798d22a3.jpg already downloaded
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F35%252F153540e8a552682eba2184291b5b6490%252Fpa%252FYT28903_8bf2eda670d790c67d61a319e7bb59ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_8bf2eda670d790c67d61a319e7bb59ad.jpg already downloaded
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F35%252F153540e8a552682eba2184291b5b6490%252Fpa%252FYT28903_a90576a31dc24567397ffb98acc6ed25.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_a90576a31dc24567397ffb98acc6ed25.jpg already downloaded
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F35%252F153540e8a552682eba2184291b5b6490%252Fpa%252FYT28903_b97d1800a119e580ebb332c7d73c77b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_b97d1800a119e580ebb332c7d73c77b6.jpg already downloaded
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F35%252F153540e8a552682eba2184291b5b6490%252Fpa%252FYT28903_f050c2068aeb7feacca1ddb913a38cae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_f050c2068aeb7feacca1ddb913a38cae.jpg already downloaded
2026-03-30 12:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b70fa3ea-1f12-5826-8109-05c4e4aa34f1, identifier: YT28903
2026-03-30 12:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b70fa3ea-1f12-5826-8109-05c4e4aa34f1 with identifier: YT28903
2026-03-30 12:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b70fa3ea-1f12-5826-8109-05c4e4aa34f1 with identifier: YT28903
2026-03-30 12:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b70fa3ea-1f12-5826-8109-05c4e4aa34f1 with identifier: YT28903 to the API
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YT28903>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:46:58Z',
 'fuel_type': 'petrol',
 'id': 'b70fa3ea-1f12-5826-8109-05c4e4aa34f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '5XBR05',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT28903',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 312928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_22cf7c9497e1aabb1e0cfe6d798d22a3.jpg',
                'https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_8bf2eda670d790c67d61a319e7bb59ad.jpg',
                'https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_a90576a31dc24567397ffb98acc6ed25.jpg',
                'https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_b97d1800a119e580ebb332c7d73c77b6.jpg',
                'https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_f050c2068aeb7feacca1ddb913a38cae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70fa3ea-1f12-5826-8109-05c4e4aa34f1/b70fa3ea-1f12-5826-8109-05c4e4aa34f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_22cf7c9497e1aabb1e0cfe6d798d22a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70fa3ea-1f12-5826-8109-05c4e4aa34f1/b70fa3ea-1f12-5826-8109-05c4e4aa34f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_8bf2eda670d790c67d61a319e7bb59ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70fa3ea-1f12-5826-8109-05c4e4aa34f1/b70fa3ea-1f12-5826-8109-05c4e4aa34f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_a90576a31dc24567397ffb98acc6ed25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70fa3ea-1f12-5826-8109-05c4e4aa34f1/b70fa3ea-1f12-5826-8109-05c4e4aa34f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_b97d1800a119e580ebb332c7d73c77b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b70fa3ea-1f12-5826-8109-05c4e4aa34f1/b70fa3ea-1f12-5826-8109-05c4e4aa34f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/35/153540e8a552682eba2184291b5b6490/pa/YT28903_f050c2068aeb7feacca1ddb913a38cae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT28903%27 HTTP/1.1" 200 None
2026-03-30 12:10:18 [auto1.nl] INFO: Saving data for YT28903: {'created_time': 1774872618.928539, 'last_price_update_time': 1774872618.928549, 'auction_closing_time': 1774972018.0}
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YT28903') HTTP/1.1" 204 0
2026-03-30 12:10:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.379(s), this was the 1st time calling it.
2026-03-30 12:10:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.501911458102643 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC34578> (referer: https://www.auto1.com/v1/car-details-view/LC34578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64 with identifier: LC34578
2026-03-30 12:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64 with scrape type 1
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_0d3eaf17287e3f7a5f179e3fc8e0af40.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_0d3eaf17287e3f7a5f179e3fc8e0af40.jpg already downloaded
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_10b2fa85ac3dbb50f1428a7796c0d639.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_10b2fa85ac3dbb50f1428a7796c0d639.jpg already downloaded
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_aabbbb0410453eb92d4caef745a83224.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_aabbbb0410453eb92d4caef745a83224.jpg already downloaded
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_ee79990a76fe0b1a1e04414bbaf4f1e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_ee79990a76fe0b1a1e04414bbaf4f1e6.jpg already downloaded
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_de007f148a43215e8adb0594a6e093f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_de007f148a43215e8adb0594a6e093f5.jpg already downloaded
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_853b060eddf69639d667850599badad3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_853b060eddf69639d667850599badad3.jpg already downloaded
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_7b93ba10089d282cb1844ccf1741d559.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_7b93ba10089d282cb1844ccf1741d559.jpg already downloaded
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_fd137bae151949ad704a3d5b18defad8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_fd137bae151949ad704a3d5b18defad8.jpg already downloaded
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_391f7f22abfad1e8b235964b8dad4a10.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_391f7f22abfad1e8b235964b8dad4a10.jpg already downloaded
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F25%252Fcb25044cfd305ab1b84a83d36d4b4a0e%252Fpa%252FLC34578_207eff7123f3bd1ac3101432b651ceb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_207eff7123f3bd1ac3101432b651ceb9.jpg already downloaded
2026-03-30 12:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64, identifier: LC34578
2026-03-30 12:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64 with identifier: LC34578
2026-03-30 12:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64 with identifier: LC34578
2026-03-30 12:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64 with identifier: LC34578 to the API
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LC34578>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:19:05Z',
 'fuel_type': 'petrol',
 'id': 'ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H434JG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC34578',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '5er',
 'odometer': 180512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_0d3eaf17287e3f7a5f179e3fc8e0af40.jpg',
                'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_10b2fa85ac3dbb50f1428a7796c0d639.jpg',
                'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_aabbbb0410453eb92d4caef745a83224.jpg',
                'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_ee79990a76fe0b1a1e04414bbaf4f1e6.jpg',
                'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_de007f148a43215e8adb0594a6e093f5.jpg',
                'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_853b060eddf69639d667850599badad3.jpg',
                'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_7b93ba10089d282cb1844ccf1741d559.jpg',
                'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_fd137bae151949ad704a3d5b18defad8.jpg',
                'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_391f7f22abfad1e8b235964b8dad4a10.jpg',
                'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_207eff7123f3bd1ac3101432b651ceb9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_0d3eaf17287e3f7a5f179e3fc8e0af40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_10b2fa85ac3dbb50f1428a7796c0d639.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_aabbbb0410453eb92d4caef745a83224.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_ee79990a76fe0b1a1e04414bbaf4f1e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_de007f148a43215e8adb0594a6e093f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_853b060eddf69639d667850599badad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_7b93ba10089d282cb1844ccf1741d559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_fd137bae151949ad704a3d5b18defad8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_391f7f22abfad1e8b235964b8dad4a10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64/ea8beff0-bad0-5fe0-8cd2-7c5b724c5c64_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/25/cb25044cfd305ab1b84a83d36d4b4a0e/pa/LC34578_207eff7123f3bd1ac3101432b651ceb9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC34578%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [auto1.nl] INFO: Saving data for LC34578: {'created_time': 1774872627.43821, 'last_price_update_time': 1774872627.438221, 'auction_closing_time': 1774970345.0}
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LC34578') HTTP/1.1" 204 0
2026-03-30 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM80557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV57323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD80531/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL69389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE79175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW12392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ71545> (referer: https://www.auto1.com/v1/car-details-view/FZ71545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01f73c91-945f-55d7-8951-16414b1163c9 with identifier: FZ71545
2026-03-30 12:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01f73c91-945f-55d7-8951-16414b1163c9 with scrape type 1
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01f73c91-945f-55d7-8951-16414b1163c9
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_be0d9528eaaee516e7c8c0195f63edb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_be0d9528eaaee516e7c8c0195f63edb6.jpg already downloaded
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_2b94827ebcfd25bbbff5286ca669d380.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_2b94827ebcfd25bbbff5286ca669d380.jpg already downloaded
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_fa5f804b05fc984fc65870afd9213ccb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_fa5f804b05fc984fc65870afd9213ccb.jpg already downloaded
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_47af1c7502e4df0a74f086cd06702a99.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_47af1c7502e4df0a74f086cd06702a99.jpg already downloaded
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_b20fb451c2651e39b5754bf97068e08c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_b20fb451c2651e39b5754bf97068e08c.jpg already downloaded
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_2dfc3d6dcf16f9e77c3747dc969920ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_2dfc3d6dcf16f9e77c3747dc969920ea.jpg already downloaded
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_662e738ffb5a5364f07fc480986d5d60.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_662e738ffb5a5364f07fc480986d5d60.jpg already downloaded
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_091a4ddecbfcf25fecd6542e9cb50df7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_091a4ddecbfcf25fecd6542e9cb50df7.jpg already downloaded
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_2fd0fbb478a96defd18c50d5301914ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_2fd0fbb478a96defd18c50d5301914ae.jpg already downloaded
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F69%252Fb169ca9b8c76019e5da77825322e181e%252Fpa%252FFZ71545_8a582dbf1e7e0e040333edce25762cf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_8a582dbf1e7e0e040333edce25762cf2.jpg already downloaded
2026-03-30 12:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 01f73c91-945f-55d7-8951-16414b1163c9, identifier: FZ71545
2026-03-30 12:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 01f73c91-945f-55d7-8951-16414b1163c9 with identifier: FZ71545
2026-03-30 12:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 01f73c91-945f-55d7-8951-16414b1163c9 with identifier: FZ71545
2026-03-30 12:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 01f73c91-945f-55d7-8951-16414b1163c9 with identifier: FZ71545 to the API
2026-03-30 12:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FZ71545>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:02:29Z',
 'fuel_type': 'petrol',
 'id': '01f73c91-945f-55d7-8951-16414b1163c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HX074G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ71545',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 43044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_be0d9528eaaee516e7c8c0195f63edb6.jpg',
                'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_2b94827ebcfd25bbbff5286ca669d380.jpg',
                'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_fa5f804b05fc984fc65870afd9213ccb.jpg',
                'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_47af1c7502e4df0a74f086cd06702a99.jpg',
                'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_b20fb451c2651e39b5754bf97068e08c.jpg',
                'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_2dfc3d6dcf16f9e77c3747dc969920ea.jpg',
                'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_662e738ffb5a5364f07fc480986d5d60.jpg',
                'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_091a4ddecbfcf25fecd6542e9cb50df7.jpg',
                'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_2fd0fbb478a96defd18c50d5301914ae.jpg',
                'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_8a582dbf1e7e0e040333edce25762cf2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_be0d9528eaaee516e7c8c0195f63edb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_2b94827ebcfd25bbbff5286ca669d380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_fa5f804b05fc984fc65870afd9213ccb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_47af1c7502e4df0a74f086cd06702a99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_b20fb451c2651e39b5754bf97068e08c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_2dfc3d6dcf16f9e77c3747dc969920ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_662e738ffb5a5364f07fc480986d5d60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_091a4ddecbfcf25fecd6542e9cb50df7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_2fd0fbb478a96defd18c50d5301914ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f73c91-945f-55d7-8951-16414b1163c9/01f73c91-945f-55d7-8951-16414b1163c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/69/b169ca9b8c76019e5da77825322e181e/pa/FZ71545_8a582dbf1e7e0e040333edce25762cf2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2016}
2026-03-30 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ71545%27 HTTP/1.1" 200 None
2026-03-30 12:10:53 [auto1.nl] INFO: Saving data for FZ71545: {'created_time': 1774872653.407528, 'last_price_update_time': 1774872653.407539, 'auction_closing_time': 1774969349.0}
2026-03-30 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FZ71545') HTTP/1.1" 204 0
2026-03-30 12:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE17571> (referer: https://www.auto1.com/v1/car-details-view/KE17571/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf2515f7-3e68-5e1a-8dd2-88d48371ce9f with identifier: KE17571
2026-03-30 12:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf2515f7-3e68-5e1a-8dd2-88d48371ce9f with scrape type 1
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf2515f7-3e68-5e1a-8dd2-88d48371ce9f
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_9f4f0e5c44f73287c7b28212382700bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_9f4f0e5c44f73287c7b28212382700bd.jpg already downloaded
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_0c13eb345126af4107878ac47d2f5565.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_0c13eb345126af4107878ac47d2f5565.jpg already downloaded
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_74578606067c6d7aa4630861cf5916a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_74578606067c6d7aa4630861cf5916a6.jpg already downloaded
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_bd722f50331cdbc4da1f955e3bec4be1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_bd722f50331cdbc4da1f955e3bec4be1.jpg already downloaded
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_2738d1095db894f411ef0ba6b24e09d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_2738d1095db894f411ef0ba6b24e09d9.jpg already downloaded
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_e892a6666711721ec655eabda37d9fc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_e892a6666711721ec655eabda37d9fc4.jpg already downloaded
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_550c7976682fbecd594f33c2ab48f532.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_550c7976682fbecd594f33c2ab48f532.jpg already downloaded
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_d52da27f51ef539b538a8202781ee1ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_d52da27f51ef539b538a8202781ee1ea.jpg already downloaded
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_a5d36ccee0f1af201472f91ebfb0a773.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_a5d36ccee0f1af201472f91ebfb0a773.jpg already downloaded
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F34%252F16341b148328bf709b28f64d4874446b%252Fpa%252FKE17571_8da3402d39cc79857d8e445dd5e7d323.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_8da3402d39cc79857d8e445dd5e7d323.jpg already downloaded
2026-03-30 12:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cf2515f7-3e68-5e1a-8dd2-88d48371ce9f, identifier: KE17571
2026-03-30 12:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cf2515f7-3e68-5e1a-8dd2-88d48371ce9f with identifier: KE17571
2026-03-30 12:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cf2515f7-3e68-5e1a-8dd2-88d48371ce9f with identifier: KE17571
2026-03-30 12:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cf2515f7-3e68-5e1a-8dd2-88d48371ce9f with identifier: KE17571 to the API
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KE17571>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:48:05Z',
 'fuel_type': 'petrol',
 'id': 'cf2515f7-3e68-5e1a-8dd2-88d48371ce9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'X335JG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE17571',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 69075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_9f4f0e5c44f73287c7b28212382700bd.jpg',
                'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_0c13eb345126af4107878ac47d2f5565.jpg',
                'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_74578606067c6d7aa4630861cf5916a6.jpg',
                'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_bd722f50331cdbc4da1f955e3bec4be1.jpg',
                'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_2738d1095db894f411ef0ba6b24e09d9.jpg',
                'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_e892a6666711721ec655eabda37d9fc4.jpg',
                'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_550c7976682fbecd594f33c2ab48f532.jpg',
                'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_d52da27f51ef539b538a8202781ee1ea.jpg',
                'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_a5d36ccee0f1af201472f91ebfb0a773.jpg',
                'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_8da3402d39cc79857d8e445dd5e7d323.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_9f4f0e5c44f73287c7b28212382700bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_0c13eb345126af4107878ac47d2f5565.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_74578606067c6d7aa4630861cf5916a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_bd722f50331cdbc4da1f955e3bec4be1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_2738d1095db894f411ef0ba6b24e09d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_e892a6666711721ec655eabda37d9fc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_550c7976682fbecd594f33c2ab48f532.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_d52da27f51ef539b538a8202781ee1ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_a5d36ccee0f1af201472f91ebfb0a773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf2515f7-3e68-5e1a-8dd2-88d48371ce9f/cf2515f7-3e68-5e1a-8dd2-88d48371ce9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/34/16341b148328bf709b28f64d4874446b/pa/KE17571_8da3402d39cc79857d8e445dd5e7d323.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 30 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE17571%27 HTTP/1.1" 200 None
2026-03-30 12:11:01 [auto1.nl] INFO: Saving data for KE17571: {'created_time': 1774872661.28657, 'last_price_update_time': 1774872661.286579, 'auction_closing_time': 1774972085.0}
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KE17571') HTTP/1.1" 204 0
2026-03-30 12:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM83384/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:07 [scrapy.extensions.logstats] INFO: Crawled 99 pages (at 12 pages/min), scraped 72 items (at 4 items/min)
2026-03-30 12:11:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 12:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH68093/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.714(s), this was the 1st time calling it.
2026-03-30 12:11:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.773363863737684 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.735(s), this was the 1st time calling it.
2026-03-30 12:12:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.840484041650505 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:07 [scrapy.extensions.logstats] INFO: Crawled 100 pages (at 1 pages/min), scraped 72 items (at 0 items/min)
2026-03-30 12:12:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 12:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST56241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG81860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV57323> (referer: https://www.auto1.com/v1/car-details-view/CV57323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with identifier: CV57323
2026-03-30 12:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with scrape type 1
2026-03-30 12:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg already downloaded
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_db025a5473219c01920a6d2cdc2affdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_db025a5473219c01920a6d2cdc2affdf.jpg already downloaded
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_8ed745d21d9fc9d16f96304433931d29.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_8ed745d21d9fc9d16f96304433931d29.jpg already downloaded
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg already downloaded
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_e7041878fafc6c9e68bea2758874d79a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_e7041878fafc6c9e68bea2758874d79a.jpg already downloaded
2026-03-30 12:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389, identifier: CV57323
2026-03-30 12:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with identifier: CV57323
2026-03-30 12:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with identifier: CV57323
2026-03-30 12:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with identifier: CV57323 to the API
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CV57323>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:02:55Z',
 'fuel_type': 'petrol',
 'id': '7406bb73-b3a5-587f-a6cb-1bc6e1c1b389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '4TGD18',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV57323',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 174800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg',
                'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_db025a5473219c01920a6d2cdc2affdf.jpg',
                'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_8ed745d21d9fc9d16f96304433931d29.jpg',
                'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg',
                'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_e7041878fafc6c9e68bea2758874d79a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_db025a5473219c01920a6d2cdc2affdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_8ed745d21d9fc9d16f96304433931d29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_e7041878fafc6c9e68bea2758874d79a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV57323%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [auto1.nl] INFO: Saving data for CV57323: {'created_time': 1774872730.427509, 'last_price_update_time': 1774872730.427522, 'auction_closing_time': 1774969375.0}
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CV57323') HTTP/1.1" 204 0
2026-03-30 12:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD80531> (referer: https://www.auto1.com/v1/car-details-view/HD80531/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f1abb45-bfa8-54aa-88ab-5c463dd9311f with identifier: HD80531
2026-03-30 12:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f with scrape type 1
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_9bedc5b99df11dafbecacc93eccdaf13.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_9bedc5b99df11dafbecacc93eccdaf13.jpg not downloaded yet
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_2a46eeece160743aead8b99eed052dfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_2a46eeece160743aead8b99eed052dfe.jpg not downloaded yet
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_17bd15ff1cad0c26fe0c8f9f4aef65ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_17bd15ff1cad0c26fe0c8f9f4aef65ae.jpg not downloaded yet
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_699241ee1afcfc6d792e533278682bf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_699241ee1afcfc6d792e533278682bf2.jpg not downloaded yet
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_2529bb91ac718af9a78f34dbe6489fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_2529bb91ac718af9a78f34dbe6489fc7.jpg not downloaded yet
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_16874ebd9d1bca4251997f5a0c85ea62.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_16874ebd9d1bca4251997f5a0c85ea62.jpg not downloaded yet
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_d82a00a83d0c060c6599729ace3b6cf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_d82a00a83d0c060c6599729ace3b6cf8.jpg not downloaded yet
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_a8278a968c90a6020e4064c427a7086c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_a8278a968c90a6020e4064c427a7086c.jpg not downloaded yet
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_f2afddb646bcc3bd6e821c65562cbef2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_f2afddb646bcc3bd6e821c65562cbef2.jpg not downloaded yet
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_1a3e2022a429d2f6ae82b44af04c2931.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_1a3e2022a429d2f6ae82b44af04c2931.jpg not downloaded yet
2026-03-30 12:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_9bedc5b99df11dafbecacc93eccdaf13.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_1a3e2022a429d2f6ae82b44af04c2931.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_f2afddb646bcc3bd6e821c65562cbef2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7834d0>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_9bedc5b99df11dafbecacc93eccdaf13.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_9bedc5b99df11dafbecacc93eccdaf13.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_a8278a968c90a6020e4064c427a7086c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed51f10>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_1a3e2022a429d2f6ae82b44af04c2931.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_1a3e2022a429d2f6ae82b44af04c2931.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7410a190>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_f2afddb646bcc3bd6e821c65562cbef2.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_f2afddb646bcc3bd6e821c65562cbef2.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_d82a00a83d0c060c6599729ace3b6cf8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eecf650>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_a8278a968c90a6020e4064c427a7086c.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_a8278a968c90a6020e4064c427a7086c.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_16874ebd9d1bca4251997f5a0c85ea62.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_2529bb91ac718af9a78f34dbe6489fc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed826d0>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_d82a00a83d0c060c6599729ace3b6cf8.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_d82a00a83d0c060c6599729ace3b6cf8.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_699241ee1afcfc6d792e533278682bf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed7c850>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_16874ebd9d1bca4251997f5a0c85ea62.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_16874ebd9d1bca4251997f5a0c85ea62.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74108890>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_2529bb91ac718af9a78f34dbe6489fc7.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_2529bb91ac718af9a78f34dbe6489fc7.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_17bd15ff1cad0c26fe0c8f9f4aef65ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eecc4d0>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_699241ee1afcfc6d792e533278682bf2.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_699241ee1afcfc6d792e533278682bf2.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_2a46eeece160743aead8b99eed052dfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed81310>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_17bd15ff1cad0c26fe0c8f9f4aef65ae.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_17bd15ff1cad0c26fe0c8f9f4aef65ae.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb8090>
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F52%252Fc352f86ac42272729c89dc9db1c71cfc%252Fpa%252FHD80531_2a46eeece160743aead8b99eed052dfe.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_2a46eeece160743aead8b99eed052dfe.jpg saved to cache
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f
2026-03-30 12:12:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f1abb45-bfa8-54aa-88ab-5c463dd9311f, skipping ID generation
2026-03-30 12:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f with scrape type 1
2026-03-30 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f1abb45-bfa8-54aa-88ab-5c463dd9311f sending to next pipeline
2026-03-30 12:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5f1abb45-bfa8-54aa-88ab-5c463dd9311f, identifier: HD80531
2026-03-30 12:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5f1abb45-bfa8-54aa-88ab-5c463dd9311f with identifier: HD80531
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 12:12:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5f1abb45-bfa8-54aa-88ab-5c463dd9311f with identifier: HD80531
2026-03-30 12:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5f1abb45-bfa8-54aa-88ab-5c463dd9311f with identifier: HD80531 to the API
2026-03-30 12:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_2a46eeece160743aead8b99eed052dfe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:45:56Z',
 'fuel_type': 'petrol',
 'id': '5f1abb45-bfa8-54aa-88ab-5c463dd9311f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L749NG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD80531',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 80120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_9bedc5b99df11dafbecacc93eccdaf13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_2a46eeece160743aead8b99eed052dfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_17bd15ff1cad0c26fe0c8f9f4aef65ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_699241ee1afcfc6d792e533278682bf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_2529bb91ac718af9a78f34dbe6489fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_16874ebd9d1bca4251997f5a0c85ea62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_d82a00a83d0c060c6599729ace3b6cf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_a8278a968c90a6020e4064c427a7086c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_f2afddb646bcc3bd6e821c65562cbef2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1abb45-bfa8-54aa-88ab-5c463dd9311f/5f1abb45-bfa8-54aa-88ab-5c463dd9311f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/52/c352f86ac42272729c89dc9db1c71cfc/pa/HD80531_1a3e2022a429d2f6ae82b44af04c2931.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD80531%27 HTTP/1.1" 200 None
2026-03-30 12:12:12 [auto1.nl] INFO: Saving data for HD80531: {'created_time': 1774872732.306788, 'last_price_update_time': 1774872732.306798, 'auction_closing_time': 1774971956.0}
2026-03-30 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HD80531') HTTP/1.1" 204 0
2026-03-30 12:12:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 539.427(s), this was the 4th time calling it.
2026-03-30 12:12:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 9.185040633146002 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.231(s), this was the 2nd time calling it.
2026-03-30 12:12:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.040789358307164 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2026-03-30 12:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA44599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE79175> (referer: https://www.auto1.com/v1/car-details-view/NE79175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b68b23-1549-5066-a9e2-d2bcd34c068b with identifier: NE79175
2026-03-30 12:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b68b23-1549-5066-a9e2-d2bcd34c068b with scrape type 1
2026-03-30 12:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a9b68b23-1549-5066-a9e2-d2bcd34c068b
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F36%252Fee361df1ee763831ae7390ae886beef2%252Fpa%252FNE79175_4f5f6171e3611807bce3f5274066e70f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_4f5f6171e3611807bce3f5274066e70f.jpg already downloaded
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F36%252Fee361df1ee763831ae7390ae886beef2%252Fpa%252FNE79175_5670751cce7f506fb045332d3959a9e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_5670751cce7f506fb045332d3959a9e4.jpg already downloaded
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F36%252Fee361df1ee763831ae7390ae886beef2%252Fpa%252FNE79175_7e9526618a417457e9040054e01f9f7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_7e9526618a417457e9040054e01f9f7c.jpg already downloaded
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F36%252Fee361df1ee763831ae7390ae886beef2%252Fpa%252FNE79175_ac501fe7a887d0adf6698a1b0f536b78.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_ac501fe7a887d0adf6698a1b0f536b78.jpg already downloaded
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F36%252Fee361df1ee763831ae7390ae886beef2%252Fpa%252FNE79175_58dc91778f26c325315078b36bd6e071.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_58dc91778f26c325315078b36bd6e071.jpg already downloaded
2026-03-30 12:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a9b68b23-1549-5066-a9e2-d2bcd34c068b, identifier: NE79175
2026-03-30 12:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a9b68b23-1549-5066-a9e2-d2bcd34c068b with identifier: NE79175
2026-03-30 12:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a9b68b23-1549-5066-a9e2-d2bcd34c068b with identifier: NE79175
2026-03-30 12:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a9b68b23-1549-5066-a9e2-d2bcd34c068b with identifier: NE79175 to the API
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE79175>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:12:48Z',
 'fuel_type': 'diesel',
 'id': 'a9b68b23-1549-5066-a9e2-d2bcd34c068b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '03XSND',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE79175',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 497087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_4f5f6171e3611807bce3f5274066e70f.jpg',
                'https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_5670751cce7f506fb045332d3959a9e4.jpg',
                'https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_7e9526618a417457e9040054e01f9f7c.jpg',
                'https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_ac501fe7a887d0adf6698a1b0f536b78.jpg',
                'https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_58dc91778f26c325315078b36bd6e071.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b68b23-1549-5066-a9e2-d2bcd34c068b/a9b68b23-1549-5066-a9e2-d2bcd34c068b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_4f5f6171e3611807bce3f5274066e70f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b68b23-1549-5066-a9e2-d2bcd34c068b/a9b68b23-1549-5066-a9e2-d2bcd34c068b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_5670751cce7f506fb045332d3959a9e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b68b23-1549-5066-a9e2-d2bcd34c068b/a9b68b23-1549-5066-a9e2-d2bcd34c068b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_7e9526618a417457e9040054e01f9f7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b68b23-1549-5066-a9e2-d2bcd34c068b/a9b68b23-1549-5066-a9e2-d2bcd34c068b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_ac501fe7a887d0adf6698a1b0f536b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b68b23-1549-5066-a9e2-d2bcd34c068b/a9b68b23-1549-5066-a9e2-d2bcd34c068b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/36/ee361df1ee763831ae7390ae886beef2/pa/NE79175_58dc91778f26c325315078b36bd6e071.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NE79175%27 HTTP/1.1" 200 None
2026-03-30 12:12:35 [auto1.nl] INFO: Saving data for NE79175: {'created_time': 1774872755.07347, 'last_price_update_time': 1774872755.073487, 'auction_closing_time': 1774969968.0}
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NE79175') HTTP/1.1" 204 0
2026-03-30 12:12:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.684(s), this was the 1st time calling it.
2026-03-30 12:12:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.668342874134995 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.043(s), this was the 1st time calling it.
2026-03-30 12:12:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.3406384161387166 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB40697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:13:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.485(s), this was the 1st time calling it.
2026-03-30 12:13:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.890959146544362 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS80457/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:13:07 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 8 pages/min), scraped 75 items (at 3 items/min)
2026-03-30 12:13:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 181MiB
2026-03-30 12:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM83384> (referer: https://www.auto1.com/v1/car-details-view/EM83384/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7c591de-1b69-540e-b68c-a82cacb7aeb9 with identifier: EM83384
2026-03-30 12:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7c591de-1b69-540e-b68c-a82cacb7aeb9 with scrape type 1
2026-03-30 12:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7c591de-1b69-540e-b68c-a82cacb7aeb9
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_be241f8ed6b214ed3f64425a6e65513f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_be241f8ed6b214ed3f64425a6e65513f.jpg already downloaded
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_2c7ce4d12123de60c42e64e142c1544c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_2c7ce4d12123de60c42e64e142c1544c.jpg already downloaded
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_cad7717ae2e80f49e385613a0ad1daf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_cad7717ae2e80f49e385613a0ad1daf5.jpg already downloaded
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_bed686fe5ac2eaec949fa78f7164b6a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_bed686fe5ac2eaec949fa78f7164b6a0.jpg already downloaded
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_068ced19e71e0ece1b7696a006708b06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_068ced19e71e0ece1b7696a006708b06.jpg already downloaded
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_5fe70add220c936e928ad1cf11f9dc79.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_5fe70add220c936e928ad1cf11f9dc79.jpg already downloaded
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_526705c10ffd9caf97d747352f4cf32b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_526705c10ffd9caf97d747352f4cf32b.jpg already downloaded
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_81c6190d9846afa7abb97956a90ac8ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_81c6190d9846afa7abb97956a90ac8ba.jpg already downloaded
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_4911a0e39e81c08340bc76f8940782b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_4911a0e39e81c08340bc76f8940782b3.jpg already downloaded
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F34%252Fc8349a53d438f6a57005d772c14349c0%252Fpa%252FEM83384_d8ff507e954bed29053ba2d055fcf5b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_d8ff507e954bed29053ba2d055fcf5b1.jpg already downloaded
2026-03-30 12:13:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7c591de-1b69-540e-b68c-a82cacb7aeb9, identifier: EM83384
2026-03-30 12:13:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7c591de-1b69-540e-b68c-a82cacb7aeb9 with identifier: EM83384
2026-03-30 12:13:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7c591de-1b69-540e-b68c-a82cacb7aeb9 with identifier: EM83384
2026-03-30 12:13:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7c591de-1b69-540e-b68c-a82cacb7aeb9 with identifier: EM83384 to the API
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM83384>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 203,
 'expiration_date': '2026-03-31T15:16:58Z',
 'fuel_type': 'hybrid',
 'id': 'e7c591de-1b69-540e-b68c-a82cacb7aeb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GZ539X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM83384',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 207553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_be241f8ed6b214ed3f64425a6e65513f.jpg',
                'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_2c7ce4d12123de60c42e64e142c1544c.jpg',
                'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_cad7717ae2e80f49e385613a0ad1daf5.jpg',
                'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_bed686fe5ac2eaec949fa78f7164b6a0.jpg',
                'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_068ced19e71e0ece1b7696a006708b06.jpg',
                'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_5fe70add220c936e928ad1cf11f9dc79.jpg',
                'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_526705c10ffd9caf97d747352f4cf32b.jpg',
                'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_81c6190d9846afa7abb97956a90ac8ba.jpg',
                'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_4911a0e39e81c08340bc76f8940782b3.jpg',
                'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_d8ff507e954bed29053ba2d055fcf5b1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_be241f8ed6b214ed3f64425a6e65513f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_2c7ce4d12123de60c42e64e142c1544c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_cad7717ae2e80f49e385613a0ad1daf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372642,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_bed686fe5ac2eaec949fa78f7164b6a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_068ced19e71e0ece1b7696a006708b06.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2639066,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_5fe70add220c936e928ad1cf11f9dc79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_526705c10ffd9caf97d747352f4cf32b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_81c6190d9846afa7abb97956a90ac8ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_4911a0e39e81c08340bc76f8940782b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c591de-1b69-540e-b68c-a82cacb7aeb9/e7c591de-1b69-540e-b68c-a82cacb7aeb9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/34/c8349a53d438f6a57005d772c14349c0/pa/EM83384_d8ff507e954bed29053ba2d055fcf5b1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Instyle 4WD',
 'year': 2015}
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM83384%27 HTTP/1.1" 200 None
2026-03-30 12:13:16 [auto1.nl] INFO: Saving data for EM83384: {'created_time': 1774872796.489433, 'last_price_update_time': 1774872796.489441, 'auction_closing_time': 1774970218.0}
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM83384') HTTP/1.1" 204 0
2026-03-30 12:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH68093> (referer: https://www.auto1.com/v1/car-details-view/EH68093/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 131f084b-426e-5895-89c6-f42815648f67 with identifier: EH68093
2026-03-30 12:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131f084b-426e-5895-89c6-f42815648f67 with scrape type 1
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 131f084b-426e-5895-89c6-f42815648f67
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_4ffaa963939e2d7a0717167ba6258b24.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_4ffaa963939e2d7a0717167ba6258b24.jpg not downloaded yet
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_7b401aa14bd398b9de2d69181029da16.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_7b401aa14bd398b9de2d69181029da16.jpg not downloaded yet
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_940072f6b5e9e1909b9cdf1538edf83b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_940072f6b5e9e1909b9cdf1538edf83b.jpg not downloaded yet
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_22b5a7ba93fefce670b4eed18286855b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_22b5a7ba93fefce670b4eed18286855b.jpg not downloaded yet
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_83726c442142574953ddcd73ec88e6ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_83726c442142574953ddcd73ec88e6ff.jpg not downloaded yet
2026-03-30 12:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_4ffaa963939e2d7a0717167ba6258b24.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_7b401aa14bd398b9de2d69181029da16.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_83726c442142574953ddcd73ec88e6ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_940072f6b5e9e1909b9cdf1538edf83b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b759336d0>
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_4ffaa963939e2d7a0717167ba6258b24.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_4ffaa963939e2d7a0717167ba6258b24.jpg saved to cache
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 131f084b-426e-5895-89c6-f42815648f67
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed31890>
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_7b401aa14bd398b9de2d69181029da16.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_7b401aa14bd398b9de2d69181029da16.jpg saved to cache
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 131f084b-426e-5895-89c6-f42815648f67
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f775d90>
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_83726c442142574953ddcd73ec88e6ff.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_83726c442142574953ddcd73ec88e6ff.jpg saved to cache
2026-03-30 12:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 131f084b-426e-5895-89c6-f42815648f67
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f780810>
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_940072f6b5e9e1909b9cdf1538edf83b.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_940072f6b5e9e1909b9cdf1538edf83b.jpg saved to cache
2026-03-30 12:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 131f084b-426e-5895-89c6-f42815648f67
2026-03-30 12:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_22b5a7ba93fefce670b4eed18286855b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740bcb10>
2026-03-30 12:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fe8%252F91e882118f7f886ac754cf3214ef88e9%252Fpa%252FEH68093_22b5a7ba93fefce670b4eed18286855b.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_22b5a7ba93fefce670b4eed18286855b.jpg saved to cache
2026-03-30 12:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 131f084b-426e-5895-89c6-f42815648f67
2026-03-30 12:13:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 131f084b-426e-5895-89c6-f42815648f67, skipping ID generation
2026-03-30 12:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131f084b-426e-5895-89c6-f42815648f67 with scrape type 1
2026-03-30 12:13:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 131f084b-426e-5895-89c6-f42815648f67 sending to next pipeline
2026-03-30 12:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 131f084b-426e-5895-89c6-f42815648f67, identifier: EH68093
2026-03-30 12:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 131f084b-426e-5895-89c6-f42815648f67 with identifier: EH68093
2026-03-30 12:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 131f084b-426e-5895-89c6-f42815648f67 with identifier: EH68093
2026-03-30 12:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 131f084b-426e-5895-89c6-f42815648f67 with identifier: EH68093 to the API
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_22b5a7ba93fefce670b4eed18286855b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:07:08Z',
 'fuel_type': 'petrol',
 'id': '131f084b-426e-5895-89c6-f42815648f67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '35LHH3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH68093',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 146687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_4ffaa963939e2d7a0717167ba6258b24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_7b401aa14bd398b9de2d69181029da16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_940072f6b5e9e1909b9cdf1538edf83b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_22b5a7ba93fefce670b4eed18286855b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_131f084b-426e-5895-89c6-f42815648f67/131f084b-426e-5895-89c6-f42815648f67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/e8/91e882118f7f886ac754cf3214ef88e9/pa/EH68093_83726c442142574953ddcd73ec88e6ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH68093%27 HTTP/1.1" 200 None
2026-03-30 12:13:18 [auto1.nl] INFO: Saving data for EH68093: {'created_time': 1774872798.660163, 'last_price_update_time': 1774872798.660174, 'auction_closing_time': 1774969628.0}
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH68093') HTTP/1.1" 204 0
2026-03-30 12:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ86635> (referer: https://www.auto1.com/v1/car-details-view/JZ86635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b with identifier: JZ86635
2026-03-30 12:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b with scrape type 1
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_19e6ec4b6b2ddd0f8dca498c8dfa5ddb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_19e6ec4b6b2ddd0f8dca498c8dfa5ddb.jpg not downloaded yet
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_6eea72ace49fa80dedd3e63cdb0f88ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_6eea72ace49fa80dedd3e63cdb0f88ce.jpg not downloaded yet
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_3866baa4fa9935ef513697c968cb8d92.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_3866baa4fa9935ef513697c968cb8d92.jpg not downloaded yet
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_14637b7aa2fd9d792656ec41533f0703.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_14637b7aa2fd9d792656ec41533f0703.jpg not downloaded yet
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_de7947e00795c2576db91535174a912b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_de7947e00795c2576db91535174a912b.jpg not downloaded yet
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_192dae2dce8c4af68746d471fe6368e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_192dae2dce8c4af68746d471fe6368e8.jpg not downloaded yet
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_6eea72ace49fa80dedd3e63cdb0f88ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_96294be41682ede607c2f265781b9903.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_96294be41682ede607c2f265781b9903.jpg not downloaded yet
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_19e6ec4b6b2ddd0f8dca498c8dfa5ddb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_ed02cbfcab7dbcd631f6be7b8f401283.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_ed02cbfcab7dbcd631f6be7b8f401283.jpg not downloaded yet
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_371cc43989556cfda8ff5f7589848e1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_371cc43989556cfda8ff5f7589848e1e.jpg not downloaded yet
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_192dae2dce8c4af68746d471fe6368e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_3866baa4fa9935ef513697c968cb8d92.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_59891dbba092ed5e0424bb99c10be9d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_59891dbba092ed5e0424bb99c10be9d8.jpg not downloaded yet
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_96294be41682ede607c2f265781b9903.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74073690>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_6eea72ace49fa80dedd3e63cdb0f88ce.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_6eea72ace49fa80dedd3e63cdb0f88ce.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_371cc43989556cfda8ff5f7589848e1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_59891dbba092ed5e0424bb99c10be9d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_ed02cbfcab7dbcd631f6be7b8f401283.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 12:13:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:13:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 12:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 12:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed2b6d0>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_19e6ec4b6b2ddd0f8dca498c8dfa5ddb.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_19e6ec4b6b2ddd0f8dca498c8dfa5ddb.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f776cd0>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_192dae2dce8c4af68746d471fe6368e8.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_192dae2dce8c4af68746d471fe6368e8.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_de7947e00795c2576db91535174a912b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74543350>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_3866baa4fa9935ef513697c968cb8d92.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_3866baa4fa9935ef513697c968cb8d92.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_14637b7aa2fd9d792656ec41533f0703.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740bed10>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_96294be41682ede607c2f265781b9903.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_96294be41682ede607c2f265781b9903.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed79810>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_371cc43989556cfda8ff5f7589848e1e.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_371cc43989556cfda8ff5f7589848e1e.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74134e10>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_59891dbba092ed5e0424bb99c10be9d8.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_59891dbba092ed5e0424bb99c10be9d8.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed83d50>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_ed02cbfcab7dbcd631f6be7b8f401283.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_ed02cbfcab7dbcd631f6be7b8f401283.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f731750>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_de7947e00795c2576db91535174a912b.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_de7947e00795c2576db91535174a912b.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eea9750>
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F48%252Fdf48ade46269e6c537b5f4f85715bf3e%252Fpa%252FJZ86635_14637b7aa2fd9d792656ec41533f0703.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_14637b7aa2fd9d792656ec41533f0703.jpg saved to cache
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b
2026-03-30 12:13:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b, skipping ID generation
2026-03-30 12:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b with scrape type 1
2026-03-30 12:13:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b sending to next pipeline
2026-03-30 12:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b, identifier: JZ86635
2026-03-30 12:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b with identifier: JZ86635
2026-03-30 12:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b with identifier: JZ86635
2026-03-30 12:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b with identifier: JZ86635 to the API
2026-03-30 12:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_14637b7aa2fd9d792656ec41533f0703.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 269,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:08:37Z',
 'fuel_type': 'petrol',
 'id': '2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ86635',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 263245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178611,
             'Height': 869,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_19e6ec4b6b2ddd0f8dca498c8dfa5ddb.jpg',
             'Width': 1179},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95804,
             'Height': 571,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_6eea72ace49fa80dedd3e63cdb0f88ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97219,
             'Height': 544,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_3866baa4fa9935ef513697c968cb8d92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78355,
             'Height': 571,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_14637b7aa2fd9d792656ec41533f0703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62726,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_de7947e00795c2576db91535174a912b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63928,
             'Height': 503,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_192dae2dce8c4af68746d471fe6368e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74849,
             'Height': 580,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_96294be41682ede607c2f265781b9903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105473,
             'Height': 588,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_ed02cbfcab7dbcd631f6be7b8f401283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77754,
             'Height': 573,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_371cc43989556cfda8ff5f7589848e1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b/2a2f68e6-d301-5dfa-bec1-e28d4f6fba9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/48/df48ade46269e6c537b5f4f85715bf3e/pa/JZ86635_59891dbba092ed5e0424bb99c10be9d8.jpg',
             'Width': 797}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-04-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.5 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 12:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ86635%27 HTTP/1.1" 200 None
2026-03-30 12:13:26 [auto1.nl] INFO: Saving data for JZ86635: {'created_time': 1774872806.247189, 'last_price_update_time': 1774872806.247202, 'auction_closing_time': 1774969717.0}
2026-03-30 12:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JZ86635') HTTP/1.1" 204 0
2026-03-30 12:13:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.274(s), this was the 1st time calling it.
2026-03-30 12:13:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.064579406220349 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:13:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM80557> (referer: https://www.auto1.com/v1/car-details-view/MM80557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 502d56c8-8a77-5ed7-abb5-91f7fed2da51 with identifier: MM80557
2026-03-30 12:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51 with scrape type 1
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_adc6595c7523630ec09c82f1ef1a282b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_adc6595c7523630ec09c82f1ef1a282b.jpg not downloaded yet
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_a935ca17741a500a95bc535ca1596dd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_a935ca17741a500a95bc535ca1596dd1.jpg not downloaded yet
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_9b98bddc1abe4b6ebc40d88939ab5617.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_9b98bddc1abe4b6ebc40d88939ab5617.jpg not downloaded yet
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_e971f239fc9d67bef4cb0e80b4670940.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_e971f239fc9d67bef4cb0e80b4670940.jpg not downloaded yet
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_27df16cdd05835486a69664b9098fda7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_27df16cdd05835486a69664b9098fda7.jpg not downloaded yet
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_9d811573191b0fb6239a705c46575a35.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_9d811573191b0fb6239a705c46575a35.jpg not downloaded yet
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_fbdfc223c85158e7d1a278a66a9a5eab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_fbdfc223c85158e7d1a278a66a9a5eab.jpg not downloaded yet
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_19dc2f14ba555b9f5be30e63e1a2880f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_19dc2f14ba555b9f5be30e63e1a2880f.jpg not downloaded yet
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_079a9899baaa2af87b6255fecdc6d748.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_079a9899baaa2af87b6255fecdc6d748.jpg not downloaded yet
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_89ae2cc536f7e15dbe638546fd26de37.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_89ae2cc536f7e15dbe638546fd26de37.jpg not downloaded yet
2026-03-30 12:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_adc6595c7523630ec09c82f1ef1a282b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_a935ca17741a500a95bc535ca1596dd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_27df16cdd05835486a69664b9098fda7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_e971f239fc9d67bef4cb0e80b4670940.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_079a9899baaa2af87b6255fecdc6d748.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_9b98bddc1abe4b6ebc40d88939ab5617.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_89ae2cc536f7e15dbe638546fd26de37.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed25ad0>
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_adc6595c7523630ec09c82f1ef1a282b.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_adc6595c7523630ec09c82f1ef1a282b.jpg saved to cache
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74111090>
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_a935ca17741a500a95bc535ca1596dd1.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_a935ca17741a500a95bc535ca1596dd1.jpg saved to cache
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_19dc2f14ba555b9f5be30e63e1a2880f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75681490>
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_27df16cdd05835486a69664b9098fda7.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_27df16cdd05835486a69664b9098fda7.jpg saved to cache
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eedbd90>
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_e971f239fc9d67bef4cb0e80b4670940.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_e971f239fc9d67bef4cb0e80b4670940.jpg saved to cache
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eec6390>
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_079a9899baaa2af87b6255fecdc6d748.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_079a9899baaa2af87b6255fecdc6d748.jpg saved to cache
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed81d50>
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_9b98bddc1abe4b6ebc40d88939ab5617.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_9b98bddc1abe4b6ebc40d88939ab5617.jpg saved to cache
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f77cc50>
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_89ae2cc536f7e15dbe638546fd26de37.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_89ae2cc536f7e15dbe638546fd26de37.jpg saved to cache
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740e1ad0>
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_19dc2f14ba555b9f5be30e63e1a2880f.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_19dc2f14ba555b9f5be30e63e1a2880f.jpg saved to cache
2026-03-30 12:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_9d811573191b0fb6239a705c46575a35.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA44599> (referer: https://www.auto1.com/v1/car-details-view/VA44599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY74168> (referer: https://www.auto1.com/v1/car-details-view/GY74168/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee3dbd0>
2026-03-30 12:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_9d811573191b0fb6239a705c46575a35.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_9d811573191b0fb6239a705c46575a35.jpg saved to cache
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f774fa0c-a2d4-5025-bd38-ed36017677d3 with identifier: VA44599
2026-03-30 12:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f774fa0c-a2d4-5025-bd38-ed36017677d3 with scrape type 1
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_e180b09eae60b198ebce3d9c1fcb3a76.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_e180b09eae60b198ebce3d9c1fcb3a76.jpg not downloaded yet
2026-03-30 12:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d727332d-aedb-5c04-918f-225c1c11cb25 with identifier: GY74168
2026-03-30 12:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d727332d-aedb-5c04-918f-225c1c11cb25 with scrape type 1
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_23b46ad8b6e627f32eddb840bdfcf702.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_23b46ad8b6e627f32eddb840bdfcf702.jpg not downloaded yet
2026-03-30 12:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_fbdfc223c85158e7d1a278a66a9a5eab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_98fda892759d4e08ba68446e4373dc57.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_98fda892759d4e08ba68446e4373dc57.jpg not downloaded yet
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_e3ce6adb09850cbfb7f2c70214bb9b10.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_e3ce6adb09850cbfb7f2c70214bb9b10.jpg not downloaded yet
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_074d15b961189aeaad224888a99274b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_074d15b961189aeaad224888a99274b3.jpg not downloaded yet
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_98095335cc5193ee00be5cc6f310b9b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_98095335cc5193ee00be5cc6f310b9b8.jpg not downloaded yet
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_3c23c63163ba413909b36f8e86ec1d3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_3c23c63163ba413909b36f8e86ec1d3d.jpg not downloaded yet
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_e0cf0090b578e84418206a801191a6c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_e0cf0090b578e84418206a801191a6c7.jpg not downloaded yet
2026-03-30 12:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_23b46ad8b6e627f32eddb840bdfcf702.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_fbd980f1881576e5055cc21a82d02963.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_fbd980f1881576e5055cc21a82d02963.jpg not downloaded yet
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_333d6660b151ff3fd9f70add34a3802c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_333d6660b151ff3fd9f70add34a3802c.jpg not downloaded yet
2026-03-30 12:13:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eea53d0>
2026-03-30 12:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fb0%252Ffdb0db5cbbfea8661a94aafec09cc53a%252Fpa%252FMM80557_fbdfc223c85158e7d1a278a66a9a5eab.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_fbdfc223c85158e7d1a278a66a9a5eab.jpg saved to cache
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51
2026-03-30 12:13:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 502d56c8-8a77-5ed7-abb5-91f7fed2da51, skipping ID generation
2026-03-30 12:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51 with scrape type 1
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 502d56c8-8a77-5ed7-abb5-91f7fed2da51 sending to next pipeline
2026-03-30 12:13:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 502d56c8-8a77-5ed7-abb5-91f7fed2da51, identifier: MM80557
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_4f27f289beeadd5a417a9c093cd787e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_4f27f289beeadd5a417a9c093cd787e2.jpg not downloaded yet
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_6b9107fe9e5ce882b8cfc028699d5c45.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_6b9107fe9e5ce882b8cfc028699d5c45.jpg not downloaded yet
2026-03-30 12:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 502d56c8-8a77-5ed7-abb5-91f7fed2da51 with identifier: MM80557
2026-03-30 12:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 502d56c8-8a77-5ed7-abb5-91f7fed2da51 with identifier: MM80557
2026-03-30 12:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 502d56c8-8a77-5ed7-abb5-91f7fed2da51 with identifier: MM80557 to the API
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_fbdfc223c85158e7d1a278a66a9a5eab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:12:45Z',
 'fuel_type': 'diesel',
 'id': '502d56c8-8a77-5ed7-abb5-91f7fed2da51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RZ623R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM80557',
 'listing': 'auction',
 'location': 'NL, Alkmaar',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 190003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2192052,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_adc6595c7523630ec09c82f1ef1a282b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2006204,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_a935ca17741a500a95bc535ca1596dd1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1947383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_9b98bddc1abe4b6ebc40d88939ab5617.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1909920,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_e971f239fc9d67bef4cb0e80b4670940.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_27df16cdd05835486a69664b9098fda7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2166932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_9d811573191b0fb6239a705c46575a35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1827975,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_fbdfc223c85158e7d1a278a66a9a5eab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_19dc2f14ba555b9f5be30e63e1a2880f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1977090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_079a9899baaa2af87b6255fecdc6d748.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_502d56c8-8a77-5ed7-abb5-91f7fed2da51/502d56c8-8a77-5ed7-abb5-91f7fed2da51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351420,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/b0/fdb0db5cbbfea8661a94aafec09cc53a/pa/MM80557_89ae2cc536f7e15dbe638546fd26de37.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2018}
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM80557%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [auto1.nl] INFO: Saving data for MM80557: {'created_time': 1774872825.134075, 'last_price_update_time': 1774872825.134091, 'auction_closing_time': 1774969965.0}
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MM80557') HTTP/1.1" 204 0
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_e3ce6adb09850cbfb7f2c70214bb9b10.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_98095335cc5193ee00be5cc6f310b9b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_98fda892759d4e08ba68446e4373dc57.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_bbf31990d897e43990f67e5c9f5a34e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_bbf31990d897e43990f67e5c9f5a34e9.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_7688797e8a9f0807f500a1f13efdb4f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_7688797e8a9f0807f500a1f13efdb4f1.jpg not downloaded yet
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed24890>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_23b46ad8b6e627f32eddb840bdfcf702.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_23b46ad8b6e627f32eddb840bdfcf702.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_e0cf0090b578e84418206a801191a6c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_bb3fb5809320f857a73255057bd25dad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_bb3fb5809320f857a73255057bd25dad.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_572515ff758016635899cf8eba6face2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_572515ff758016635899cf8eba6face2.jpg not downloaded yet
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee68d90>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_e3ce6adb09850cbfb7f2c70214bb9b10.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_e3ce6adb09850cbfb7f2c70214bb9b10.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f74ca90>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_98095335cc5193ee00be5cc6f310b9b8.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_98095335cc5193ee00be5cc6f310b9b8.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f77afd0>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_98fda892759d4e08ba68446e4373dc57.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_98fda892759d4e08ba68446e4373dc57.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_027ce6b50ddc84c1b94c8fde159d54a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_027ce6b50ddc84c1b94c8fde159d54a6.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_7ebcc2d264e05248a900b2331466391a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_7ebcc2d264e05248a900b2331466391a.jpg not downloaded yet
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_6b9107fe9e5ce882b8cfc028699d5c45.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_4f27f289beeadd5a417a9c093cd787e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_7c3888678d03bb23f746d62f5b7dbb2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_7c3888678d03bb23f746d62f5b7dbb2d.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_a7604c32091b9e85f76c993279f8b1c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_a7604c32091b9e85f76c993279f8b1c5.jpg not downloaded yet
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_7688797e8a9f0807f500a1f13efdb4f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b740a2950>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_e0cf0090b578e84418206a801191a6c7.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_e0cf0090b578e84418206a801191a6c7.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_572515ff758016635899cf8eba6face2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee52490>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_6b9107fe9e5ce882b8cfc028699d5c45.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_6b9107fe9e5ce882b8cfc028699d5c45.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee53910>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_4f27f289beeadd5a417a9c093cd787e2.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_4f27f289beeadd5a417a9c093cd787e2.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_a7604c32091b9e85f76c993279f8b1c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_333d6660b151ff3fd9f70add34a3802c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75931910>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_7688797e8a9f0807f500a1f13efdb4f1.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_7688797e8a9f0807f500a1f13efdb4f1.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee7f1d0>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_572515ff758016635899cf8eba6face2.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_572515ff758016635899cf8eba6face2.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee56590>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_a7604c32091b9e85f76c993279f8b1c5.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_a7604c32091b9e85f76c993279f8b1c5.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f78ffd0>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_333d6660b151ff3fd9f70add34a3802c.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_333d6660b151ff3fd9f70add34a3802c.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_7ebcc2d264e05248a900b2331466391a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_e180b09eae60b198ebce3d9c1fcb3a76.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_074d15b961189aeaad224888a99274b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_fbd980f1881576e5055cc21a82d02963.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_3c23c63163ba413909b36f8e86ec1d3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_027ce6b50ddc84c1b94c8fde159d54a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_7c3888678d03bb23f746d62f5b7dbb2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_bb3fb5809320f857a73255057bd25dad.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f76ec50>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fd8%252F9ad8e66223936f73e26cdb7d1f4a0b33%252Fpa%252FGY74168_7ebcc2d264e05248a900b2331466391a.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_7ebcc2d264e05248a900b2331466391a.jpg saved to cache
2026-03-30 12:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d727332d-aedb-5c04-918f-225c1c11cb25
2026-03-30 12:13:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d727332d-aedb-5c04-918f-225c1c11cb25, skipping ID generation
2026-03-30 12:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d727332d-aedb-5c04-918f-225c1c11cb25 with scrape type 1
2026-03-30 12:13:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d727332d-aedb-5c04-918f-225c1c11cb25 sending to next pipeline
2026-03-30 12:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d727332d-aedb-5c04-918f-225c1c11cb25, identifier: GY74168
2026-03-30 12:13:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee89a10>
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_e180b09eae60b198ebce3d9c1fcb3a76.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_e180b09eae60b198ebce3d9c1fcb3a76.jpg saved to cache
2026-03-30 12:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d727332d-aedb-5c04-918f-225c1c11cb25 with identifier: GY74168
2026-03-30 12:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d727332d-aedb-5c04-918f-225c1c11cb25 with identifier: GY74168
2026-03-30 12:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d727332d-aedb-5c04-918f-225c1c11cb25 with identifier: GY74168 to the API
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_7ebcc2d264e05248a900b2331466391a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:50Z',
 'fuel_type': 'petrol',
 'id': 'd727332d-aedb-5c04-918f-225c1c11cb25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R939SB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY74168',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 155081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_23b46ad8b6e627f32eddb840bdfcf702.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_e3ce6adb09850cbfb7f2c70214bb9b10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_98095335cc5193ee00be5cc6f310b9b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_e0cf0090b578e84418206a801191a6c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_333d6660b151ff3fd9f70add34a3802c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_6b9107fe9e5ce882b8cfc028699d5c45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_7688797e8a9f0807f500a1f13efdb4f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_572515ff758016635899cf8eba6face2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_7ebcc2d264e05248a900b2331466391a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d727332d-aedb-5c04-918f-225c1c11cb25/d727332d-aedb-5c04-918f-225c1c11cb25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/d8/9ad8e66223936f73e26cdb7d1f4a0b33/pa/GY74168_a7604c32091b9e85f76c993279f8b1c5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI S line',
 'transmission': 'manual',
 'trim': 'S line',
 'year': 2020}
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY74168%27 HTTP/1.1" 200 None
2026-03-30 12:13:46 [auto1.nl] INFO: Saving data for GY74168: {'created_time': 1774872826.733378, 'last_price_update_time': 1774872826.733392, 'auction_closing_time': 1774972010.0}
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GY74168') HTTP/1.1" 204 0
2026-03-30 12:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_bbf31990d897e43990f67e5c9f5a34e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee51e50>
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_074d15b961189aeaad224888a99274b3.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_074d15b961189aeaad224888a99274b3.jpg saved to cache
2026-03-30 12:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f753ed0>
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_fbd980f1881576e5055cc21a82d02963.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_fbd980f1881576e5055cc21a82d02963.jpg saved to cache
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee59690>
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_3c23c63163ba413909b36f8e86ec1d3d.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_3c23c63163ba413909b36f8e86ec1d3d.jpg saved to cache
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f762a50>
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_027ce6b50ddc84c1b94c8fde159d54a6.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_027ce6b50ddc84c1b94c8fde159d54a6.jpg saved to cache
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee6a590>
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_7c3888678d03bb23f746d62f5b7dbb2d.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_7c3888678d03bb23f746d62f5b7dbb2d.jpg saved to cache
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed80890>
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_bb3fb5809320f857a73255057bd25dad.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_bb3fb5809320f857a73255057bd25dad.jpg saved to cache
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb1910>
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fb3%252F31b3ddb6a3e1717e4ccb11138f13012f%252Fpa%252FVA44599_bbf31990d897e43990f67e5c9f5a34e9.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_bbf31990d897e43990f67e5c9f5a34e9.jpg saved to cache
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f774fa0c-a2d4-5025-bd38-ed36017677d3
2026-03-30 12:13:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f774fa0c-a2d4-5025-bd38-ed36017677d3, skipping ID generation
2026-03-30 12:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f774fa0c-a2d4-5025-bd38-ed36017677d3 with scrape type 1
2026-03-30 12:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f774fa0c-a2d4-5025-bd38-ed36017677d3 sending to next pipeline
2026-03-30 12:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f774fa0c-a2d4-5025-bd38-ed36017677d3, identifier: VA44599
2026-03-30 12:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f774fa0c-a2d4-5025-bd38-ed36017677d3 with identifier: VA44599
2026-03-30 12:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f774fa0c-a2d4-5025-bd38-ed36017677d3 with identifier: VA44599
2026-03-30 12:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f774fa0c-a2d4-5025-bd38-ed36017677d3 with identifier: VA44599 to the API
2026-03-30 12:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_bbf31990d897e43990f67e5c9f5a34e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:57:48Z',
 'fuel_type': 'petrol',
 'id': 'f774fa0c-a2d4-5025-bd38-ed36017677d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '1XBV62',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA44599',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'BMW',
 'model': '3er',
 'odometer': 236116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3238860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_e180b09eae60b198ebce3d9c1fcb3a76.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_98fda892759d4e08ba68446e4373dc57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3422279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_074d15b961189aeaad224888a99274b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011915,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_3c23c63163ba413909b36f8e86ec1d3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3288847,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_fbd980f1881576e5055cc21a82d02963.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_4f27f289beeadd5a417a9c093cd787e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_bbf31990d897e43990f67e5c9f5a34e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3234305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_bb3fb5809320f857a73255057bd25dad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3102719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_027ce6b50ddc84c1b94c8fde159d54a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f774fa0c-a2d4-5025-bd38-ed36017677d3/f774fa0c-a2d4-5025-bd38-ed36017677d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3019284,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/b3/31b3ddb6a3e1717e4ccb11138f13012f/pa/VA44599_7c3888678d03bb23f746d62f5b7dbb2d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 12:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA44599%27 HTTP/1.1" 200 None
2026-03-30 12:13:48 [auto1.nl] INFO: Saving data for VA44599: {'created_time': 1774872828.169237, 'last_price_update_time': 1774872828.169248, 'auction_closing_time': 1774972668.0}
2026-03-30 12:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA44599') HTTP/1.1" 204 0
2026-03-30 12:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS80457> (referer: https://www.auto1.com/v1/car-details-view/CS80457/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25cac061-093a-5b65-86a2-d0d9793f1806 with identifier: CS80457
2026-03-30 12:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25cac061-093a-5b65-86a2-d0d9793f1806 with scrape type 1
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_a41dcf1125534802e164a0bba53a6dcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_a41dcf1125534802e164a0bba53a6dcc.jpg not downloaded yet
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_5339ac2575874ab60d94a8e6753356cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_5339ac2575874ab60d94a8e6753356cb.jpg not downloaded yet
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_8d8390e25db595213dc52495f294e864.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_8d8390e25db595213dc52495f294e864.jpg not downloaded yet
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_b3f163f2fd11d3356bb020ea1f04761e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_b3f163f2fd11d3356bb020ea1f04761e.jpg not downloaded yet
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_307cd114ca3114f72ce7f61fdef77992.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_307cd114ca3114f72ce7f61fdef77992.jpg not downloaded yet
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_9bec03833de5c70a312533bf67f437ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_9bec03833de5c70a312533bf67f437ce.jpg not downloaded yet
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_4f2a3fdf7dac98d2c6216ff24df37f5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_4f2a3fdf7dac98d2c6216ff24df37f5d.jpg not downloaded yet
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_0ae76334d1794559426b11645a4b51a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_0ae76334d1794559426b11645a4b51a3.jpg not downloaded yet
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_45b8c69580c7c3e1a60a561f51177907.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_45b8c69580c7c3e1a60a561f51177907.jpg not downloaded yet
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_828975cc2f4956eb09b39ad40bec3e89.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_828975cc2f4956eb09b39ad40bec3e89.jpg not downloaded yet
2026-03-30 12:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_b3f163f2fd11d3356bb020ea1f04761e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_a41dcf1125534802e164a0bba53a6dcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_8d8390e25db595213dc52495f294e864.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_307cd114ca3114f72ce7f61fdef77992.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75a00850>
2026-03-30 12:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_b3f163f2fd11d3356bb020ea1f04761e.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_b3f163f2fd11d3356bb020ea1f04761e.jpg saved to cache
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_0ae76334d1794559426b11645a4b51a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeb02d0>
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_a41dcf1125534802e164a0bba53a6dcc.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_a41dcf1125534802e164a0bba53a6dcc.jpg saved to cache
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f731b10>
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_8d8390e25db595213dc52495f294e864.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_8d8390e25db595213dc52495f294e864.jpg saved to cache
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee3e510>
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_307cd114ca3114f72ce7f61fdef77992.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_307cd114ca3114f72ce7f61fdef77992.jpg saved to cache
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_5339ac2575874ab60d94a8e6753356cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_4f2a3fdf7dac98d2c6216ff24df37f5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74083b90>
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_0ae76334d1794559426b11645a4b51a3.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_0ae76334d1794559426b11645a4b51a3.jpg saved to cache
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_9bec03833de5c70a312533bf67f437ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_45b8c69580c7c3e1a60a561f51177907.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_828975cc2f4956eb09b39ad40bec3e89.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eebec90>
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_5339ac2575874ab60d94a8e6753356cb.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_5339ac2575874ab60d94a8e6753356cb.jpg saved to cache
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74082650>
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_4f2a3fdf7dac98d2c6216ff24df37f5d.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_4f2a3fdf7dac98d2c6216ff24df37f5d.jpg saved to cache
2026-03-30 12:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee222d0>
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_9bec03833de5c70a312533bf67f437ce.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_9bec03833de5c70a312533bf67f437ce.jpg saved to cache
2026-03-30 12:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b757f0b90>
2026-03-30 12:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_45b8c69580c7c3e1a60a561f51177907.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_45b8c69580c7c3e1a60a561f51177907.jpg saved to cache
2026-03-30 12:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74083750>
2026-03-30 12:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fab%252F20ab7552aeda39306955d92586381432%252Fpa%252FCS80457_828975cc2f4956eb09b39ad40bec3e89.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_828975cc2f4956eb09b39ad40bec3e89.jpg saved to cache
2026-03-30 12:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25cac061-093a-5b65-86a2-d0d9793f1806
2026-03-30 12:13:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25cac061-093a-5b65-86a2-d0d9793f1806, skipping ID generation
2026-03-30 12:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25cac061-093a-5b65-86a2-d0d9793f1806 with scrape type 1
2026-03-30 12:13:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25cac061-093a-5b65-86a2-d0d9793f1806 sending to next pipeline
2026-03-30 12:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 25cac061-093a-5b65-86a2-d0d9793f1806, identifier: CS80457
2026-03-30 12:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 25cac061-093a-5b65-86a2-d0d9793f1806 with identifier: CS80457
2026-03-30 12:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 25cac061-093a-5b65-86a2-d0d9793f1806 with identifier: CS80457
2026-03-30 12:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 25cac061-093a-5b65-86a2-d0d9793f1806 with identifier: CS80457 to the API
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_828975cc2f4956eb09b39ad40bec3e89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:13:05Z',
 'fuel_type': 'diesel',
 'id': '25cac061-093a-5b65-86a2-d0d9793f1806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PH-607-D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS80457',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 226904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3535095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_a41dcf1125534802e164a0bba53a6dcc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3377993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_5339ac2575874ab60d94a8e6753356cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3275659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_8d8390e25db595213dc52495f294e864.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2832857,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_b3f163f2fd11d3356bb020ea1f04761e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3010808,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_307cd114ca3114f72ce7f61fdef77992.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3352527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_9bec03833de5c70a312533bf67f437ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3201986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_4f2a3fdf7dac98d2c6216ff24df37f5d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_0ae76334d1794559426b11645a4b51a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3299903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_45b8c69580c7c3e1a60a561f51177907.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25cac061-093a-5b65-86a2-d0d9793f1806/25cac061-093a-5b65-86a2-d0d9793f1806_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3323819,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/ab/20ab7552aeda39306955d92586381432/pa/CS80457_828975cc2f4956eb09b39ad40bec3e89.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Business wagon',
 'transmission': 'manual',
 'trim': 'Business wagon',
 'year': 2017}
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS80457%27 HTTP/1.1" 200 None
2026-03-30 12:13:51 [auto1.nl] INFO: Saving data for CS80457: {'created_time': 1774872831.817449, 'last_price_update_time': 1774872831.817459, 'auction_closing_time': 1774969985.0}
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CS80457') HTTP/1.1" 204 0
2026-03-30 12:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB40697> (referer: https://www.auto1.com/v1/car-details-view/RB40697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d500b0b6-3df3-5ea7-8ddf-5b353274cbf7 with identifier: RB40697
2026-03-30 12:14:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d500b0b6-3df3-5ea7-8ddf-5b353274cbf7 with scrape type 1
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d500b0b6-3df3-5ea7-8ddf-5b353274cbf7
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_8237d5856ef1c1ac68d6f5a376912a26.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_8237d5856ef1c1ac68d6f5a376912a26.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_f10f7747662ac2c077183f7e1e4bbda6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_f10f7747662ac2c077183f7e1e4bbda6.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_7935f30743af2b8089b0a1b58ecc79f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_7935f30743af2b8089b0a1b58ecc79f0.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_d7ecfa0f0c0fc8f522a7ba39849a5e7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_d7ecfa0f0c0fc8f522a7ba39849a5e7b.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_7e872514756d50bb1d5ae28e996f5b39.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_7e872514756d50bb1d5ae28e996f5b39.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_fe352d4a374e8268aaf1d2f6f80d86e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_fe352d4a374e8268aaf1d2f6f80d86e8.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_8e9e1b2e8a794e36f2bad7a3a9479a18.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_8e9e1b2e8a794e36f2bad7a3a9479a18.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_c71c908bcad526a3a92b6a1f5df866ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_c71c908bcad526a3a92b6a1f5df866ed.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_22b6ebc087cb64ee6accd2e6acbb9659.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_22b6ebc087cb64ee6accd2e6acbb9659.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F64%252F54645ba87e5037f2550879701564298d%252Fpa%252FRB40697_7351f4e0933ebe6a6e6f133bfd682794.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_7351f4e0933ebe6a6e6f133bfd682794.jpg already downloaded
2026-03-30 12:14:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d500b0b6-3df3-5ea7-8ddf-5b353274cbf7, identifier: RB40697
2026-03-30 12:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d500b0b6-3df3-5ea7-8ddf-5b353274cbf7 with identifier: RB40697
2026-03-30 12:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d500b0b6-3df3-5ea7-8ddf-5b353274cbf7 with identifier: RB40697
2026-03-30 12:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d500b0b6-3df3-5ea7-8ddf-5b353274cbf7 with identifier: RB40697 to the API
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RB40697>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 207,
 'expiration_date': '2026-03-31T15:41:55Z',
 'fuel_type': 'petrol',
 'id': 'd500b0b6-3df3-5ea7-8ddf-5b353274cbf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GTP-62-X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB40697',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 76647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_8237d5856ef1c1ac68d6f5a376912a26.jpg',
                'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_f10f7747662ac2c077183f7e1e4bbda6.jpg',
                'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_7935f30743af2b8089b0a1b58ecc79f0.jpg',
                'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_d7ecfa0f0c0fc8f522a7ba39849a5e7b.jpg',
                'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_7e872514756d50bb1d5ae28e996f5b39.jpg',
                'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_fe352d4a374e8268aaf1d2f6f80d86e8.jpg',
                'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_8e9e1b2e8a794e36f2bad7a3a9479a18.jpg',
                'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_c71c908bcad526a3a92b6a1f5df866ed.jpg',
                'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_22b6ebc087cb64ee6accd2e6acbb9659.jpg',
                'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_7351f4e0933ebe6a6e6f133bfd682794.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_8237d5856ef1c1ac68d6f5a376912a26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_f10f7747662ac2c077183f7e1e4bbda6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_7935f30743af2b8089b0a1b58ecc79f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_d7ecfa0f0c0fc8f522a7ba39849a5e7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_7e872514756d50bb1d5ae28e996f5b39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_fe352d4a374e8268aaf1d2f6f80d86e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_8e9e1b2e8a794e36f2bad7a3a9479a18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_c71c908bcad526a3a92b6a1f5df866ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_22b6ebc087cb64ee6accd2e6acbb9659.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d500b0b6-3df3-5ea7-8ddf-5b353274cbf7/d500b0b6-3df3-5ea7-8ddf-5b353274cbf7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/64/54645ba87e5037f2550879701564298d/pa/RB40697_7351f4e0933ebe6a6e6f133bfd682794.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Corsa 1.6 Turbo OPC',
 'transmission': 'manual',
 'trim': 'OPC',
 'year': 2016}
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RB40697%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [auto1.nl] INFO: Saving data for RB40697: {'created_time': 1774872845.40161, 'last_price_update_time': 1774872845.401619, 'auction_closing_time': 1774971715.0}
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RB40697') HTTP/1.1" 204 0
2026-03-30 12:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:07 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 1027 | hits on page: 40
2026-03-30 12:14:07 [auto1.nl] INFO: Found listing with ID: SD51522
2026-03-30 12:14:07 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV74945%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.nl] INFO: Scrape type for GV74945: 0
2026-03-30 12:14:07 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU05681%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.nl] INFO: Scrape type for NU05681: 2
2026-03-30 12:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with identifier: NU05681
2026-03-30 12:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with scrape type 2
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with scrape type 2
2026-03-30 12:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9, identifier: NU05681
2026-03-30 12:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with identifier: NU05681
2026-03-30 12:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with identifier: NU05681
2026-03-30 12:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with identifier: NU05681 to the API
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:51:38Z',
 'fuel_type': 'petrol',
 'id': 'b4d84eff-4fa8-57f9-a1b2-a01d24790cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU05681',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 217220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-03',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Style 2WD',
 'transmission': 'automatic',
 'trim': 'Style 2WD',
 'year': 2010}
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU05681%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.nl] INFO: Saving data for NU05681: {'auction_closing_time': 1774972298.0, 'created_time': 1774008063.691086, 'last_price_update_time': 1774872847.540657}
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NU05681') HTTP/1.1" 204 0
2026-03-30 12:14:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:07 [auto1.nl] INFO: Found listing with ID: SB09763
2026-03-30 12:14:07 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC64486%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.nl] INFO: Scrape type for PC64486: 2
2026-03-30 12:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with identifier: PC64486
2026-03-30 12:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with scrape type 2
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with scrape type 2
2026-03-30 12:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf, identifier: PC64486
2026-03-30 12:14:07 [scrapy.extensions.logstats] INFO: Crawled 117 pages (at 9 pages/min), scraped 84 items (at 9 items/min)
2026-03-30 12:14:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with identifier: PC64486
2026-03-30 12:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with identifier: PC64486
2026-03-30 12:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with identifier: PC64486 to the API
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:59:55Z',
 'fuel_type': 'petrol',
 'id': '7d4e9b9c-8e49-5e71-909c-3826625ec4cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC64486',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 156774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Citroen C5 1.6 THP Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2014}
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC64486%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.nl] INFO: Saving data for PC64486: {'auction_closing_time': 1774972795.0, 'created_time': 1773131926.568362, 'last_price_update_time': 1774872848.091158}
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PC64486') HTTP/1.1" 204 0
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: PK96400
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: SH83411
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: LF57152
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF57152%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.nl] INFO: Scrape type for LF57152: 1
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: NJ28414
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: PY04888
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY04888%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.nl] INFO: Scrape type for PY04888: 2
2026-03-30 12:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40ae03c3-bcd5-59db-bb68-7191b8d1db8e with identifier: PY04888
2026-03-30 12:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40ae03c3-bcd5-59db-bb68-7191b8d1db8e with scrape type 2
2026-03-30 12:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40ae03c3-bcd5-59db-bb68-7191b8d1db8e with scrape type 2
2026-03-30 12:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40ae03c3-bcd5-59db-bb68-7191b8d1db8e, identifier: PY04888
2026-03-30 12:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40ae03c3-bcd5-59db-bb68-7191b8d1db8e with identifier: PY04888
2026-03-30 12:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40ae03c3-bcd5-59db-bb68-7191b8d1db8e with identifier: PY04888
2026-03-30 12:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40ae03c3-bcd5-59db-bb68-7191b8d1db8e with identifier: PY04888 to the API
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:18:43Z',
 'fuel_type': 'petrol',
 'id': '40ae03c3-bcd5-59db-bb68-7191b8d1db8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY04888',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 254141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-23',
 'seller_name': None,
 'title': 'Citroen C5 1.6 Business Class',
 'transmission': 'manual',
 'trim': 'Business Class',
 'year': 2011}
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY04888%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.nl] INFO: Saving data for PY04888: {'auction_closing_time': 1774970323.0, 'created_time': 1774292490.67942, 'last_price_update_time': 1774872848.569518}
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY04888') HTTP/1.1" 204 0
2026-03-30 12:14:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: AA50190
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: BR90130
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: TX69728
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TX69728%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.nl] INFO: Scrape type for TX69728: 1
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: NX43694
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: TA42308
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA42308%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.nl] INFO: Scrape type for TA42308: 1
2026-03-30 12:14:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-30 12:14:08 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS32339%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.nl] INFO: Scrape type for VS32339: 2
2026-03-30 12:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850de4f1-5782-547a-86ca-dc8f47e78175 with identifier: VS32339
2026-03-30 12:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850de4f1-5782-547a-86ca-dc8f47e78175 with scrape type 2
2026-03-30 12:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850de4f1-5782-547a-86ca-dc8f47e78175 with scrape type 2
2026-03-30 12:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 850de4f1-5782-547a-86ca-dc8f47e78175, identifier: VS32339
2026-03-30 12:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 850de4f1-5782-547a-86ca-dc8f47e78175 with identifier: VS32339
2026-03-30 12:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 850de4f1-5782-547a-86ca-dc8f47e78175 with identifier: VS32339
2026-03-30 12:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 850de4f1-5782-547a-86ca-dc8f47e78175 with identifier: VS32339 to the API
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:44:53Z',
 'fuel_type': 'petrol',
 'id': '850de4f1-5782-547a-86ca-dc8f47e78175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS32339',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 118911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Petit Filou',
 'transmission': 'manual',
 'trim': 'Petit Filou',
 'year': 2011}
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS32339%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.nl] INFO: Saving data for VS32339: {'auction_closing_time': 1774971893.0, 'created_time': 1773232426.699619, 'last_price_update_time': 1774872849.200089}
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VS32339') HTTP/1.1" 204 0
2026-03-30 12:14:09 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM29173%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.nl] INFO: Scrape type for VM29173: 2
2026-03-30 12:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173
2026-03-30 12:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84e3317-ddd1-523b-9a75-a66dcc4b3359 with scrape type 2
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f84e3317-ddd1-523b-9a75-a66dcc4b3359 with scrape type 2
2026-03-30 12:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f84e3317-ddd1-523b-9a75-a66dcc4b3359, identifier: VM29173
2026-03-30 12:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173
2026-03-30 12:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173
2026-03-30 12:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173 to the API
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-31T15:03:36Z',
 'fuel_type': 'petrol',
 'id': 'f84e3317-ddd1-523b-9a75-a66dcc4b3359',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM29173',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Atos',
 'odometer': 165517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-01-03',
 'seller_name': None,
 'title': 'Hyundai Atos 1.0 GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 2002}
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM29173%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.nl] INFO: Saving data for VM29173: {'auction_closing_time': 1774969416.0, 'created_time': 1774612899.552988, 'last_price_update_time': 1774872849.635517}
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VM29173') HTTP/1.1" 204 0
2026-03-30 12:14:09 [auto1.nl] INFO: Found listing with ID: GW12777
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW12777%27 HTTP/1.1" 200 None
2026-03-30 12:14:09 [auto1.nl] INFO: Scrape type for GW12777: 2
2026-03-30 12:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4df89a4-06a9-5c58-af32-615393908d6f with identifier: GW12777
2026-03-30 12:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4df89a4-06a9-5c58-af32-615393908d6f with scrape type 2
2026-03-30 12:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4df89a4-06a9-5c58-af32-615393908d6f with scrape type 2
2026-03-30 12:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c4df89a4-06a9-5c58-af32-615393908d6f, identifier: GW12777
2026-03-30 12:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c4df89a4-06a9-5c58-af32-615393908d6f with identifier: GW12777
2026-03-30 12:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c4df89a4-06a9-5c58-af32-615393908d6f with identifier: GW12777
2026-03-30 12:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c4df89a4-06a9-5c58-af32-615393908d6f with identifier: GW12777 to the API
2026-03-30 12:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-31T15:26:51Z',
 'fuel_type': 'petrol',
 'id': 'c4df89a4-06a9-5c58-af32-615393908d6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW12777',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 92044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW12777%27 HTTP/1.1" 200 None
2026-03-30 12:14:10 [auto1.nl] INFO: Saving data for GW12777: {'auction_closing_time': 1774970811.0, 'created_time': 1773489708.460935, 'last_price_update_time': 1774872850.755399}
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW12777') HTTP/1.1" 204 0
2026-03-30 12:14:10 [auto1.nl] INFO: Found listing with ID: ZE62663
2026-03-30 12:14:10 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA94129%27 HTTP/1.1" 200 None
2026-03-30 12:14:10 [auto1.nl] INFO: Scrape type for EA94129: 2
2026-03-30 12:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: def9022e-932b-5d82-9b30-edf025877cfa with identifier: EA94129
2026-03-30 12:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def9022e-932b-5d82-9b30-edf025877cfa with scrape type 2
2026-03-30 12:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item def9022e-932b-5d82-9b30-edf025877cfa with scrape type 2
2026-03-30 12:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: def9022e-932b-5d82-9b30-edf025877cfa, identifier: EA94129
2026-03-30 12:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: def9022e-932b-5d82-9b30-edf025877cfa with identifier: EA94129
2026-03-30 12:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: def9022e-932b-5d82-9b30-edf025877cfa with identifier: EA94129
2026-03-30 12:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: def9022e-932b-5d82-9b30-edf025877cfa with identifier: EA94129 to the API
2026-03-30 12:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 126,
 'expiration_date': '2026-03-31T15:47:38Z',
 'fuel_type': 'petrol',
 'id': 'def9022e-932b-5d82-9b30-edf025877cfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA94129',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 122399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-02',
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2019}
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA94129%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [auto1.nl] INFO: Saving data for EA94129: {'auction_closing_time': 1774972058.0, 'created_time': 1773131973.906646, 'last_price_update_time': 1774872851.249929}
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EA94129') HTTP/1.1" 204 0
2026-03-30 12:14:11 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-30 12:14:11 [auto1.nl] INFO: Found listing with ID: GE59492
2026-03-30 12:14:11 [auto1.nl] INFO: Found listing with ID: UU65175
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU65175%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [auto1.nl] INFO: Scrape type for UU65175: 2
2026-03-30 12:14:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e3bb7c5-0940-576e-80ca-de2af48e7fe5 with identifier: UU65175
2026-03-30 12:14:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e3bb7c5-0940-576e-80ca-de2af48e7fe5 with scrape type 2
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e3bb7c5-0940-576e-80ca-de2af48e7fe5 with scrape type 2
2026-03-30 12:14:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e3bb7c5-0940-576e-80ca-de2af48e7fe5, identifier: UU65175
2026-03-30 12:14:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e3bb7c5-0940-576e-80ca-de2af48e7fe5 with identifier: UU65175
2026-03-30 12:14:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e3bb7c5-0940-576e-80ca-de2af48e7fe5 with identifier: UU65175
2026-03-30 12:14:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e3bb7c5-0940-576e-80ca-de2af48e7fe5 with identifier: UU65175 to the API
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:33:09Z',
 'fuel_type': 'petrol',
 'id': '1e3bb7c5-0940-576e-80ca-de2af48e7fe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU65175',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 168761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-06',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 LX',
 'transmission': 'manual',
 'trim': 'LX',
 'year': 2006}
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU65175%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [auto1.nl] INFO: Saving data for UU65175: {'auction_closing_time': 1774971189.0, 'created_time': 1774378937.16163, 'last_price_update_time': 1774872851.7626}
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UU65175') HTTP/1.1" 204 0
2026-03-30 12:14:11 [auto1.nl] INFO: Found listing with ID: XC64033
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC64033%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [auto1.nl] INFO: Scrape type for XC64033: 2
2026-03-30 12:14:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d5499cc-92f5-512f-b7d6-c89bddd81413 with identifier: XC64033
2026-03-30 12:14:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d5499cc-92f5-512f-b7d6-c89bddd81413 with scrape type 2
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d5499cc-92f5-512f-b7d6-c89bddd81413 with scrape type 2
2026-03-30 12:14:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3d5499cc-92f5-512f-b7d6-c89bddd81413, identifier: XC64033
2026-03-30 12:14:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3d5499cc-92f5-512f-b7d6-c89bddd81413 with identifier: XC64033
2026-03-30 12:14:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3d5499cc-92f5-512f-b7d6-c89bddd81413 with identifier: XC64033
2026-03-30 12:14:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3d5499cc-92f5-512f-b7d6-c89bddd81413 with identifier: XC64033 to the API
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:26:28Z',
 'fuel_type': 'petrol',
 'id': '3d5499cc-92f5-512f-b7d6-c89bddd81413',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC64033',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 279189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-17',
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC64033%27 HTTP/1.1" 200 None
2026-03-30 12:14:12 [auto1.nl] INFO: Saving data for XC64033: {'auction_closing_time': 1774970788.0, 'created_time': 1774378958.702918, 'last_price_update_time': 1774872852.274119}
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XC64033') HTTP/1.1" 204 0
2026-03-30 12:14:12 [auto1.nl] INFO: Found listing with ID: GE92727
2026-03-30 12:14:12 [auto1.nl] INFO: Found listing with ID: XE20082
2026-03-30 12:14:12 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL32110%27 HTTP/1.1" 200 None
2026-03-30 12:14:12 [auto1.nl] INFO: Scrape type for TL32110: 2
2026-03-30 12:14:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33f13026-21b5-51ce-8e49-01aeae43c353 with identifier: TL32110
2026-03-30 12:14:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33f13026-21b5-51ce-8e49-01aeae43c353 with scrape type 2
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33f13026-21b5-51ce-8e49-01aeae43c353 with scrape type 2
2026-03-30 12:14:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 33f13026-21b5-51ce-8e49-01aeae43c353, identifier: TL32110
2026-03-30 12:14:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 33f13026-21b5-51ce-8e49-01aeae43c353 with identifier: TL32110
2026-03-30 12:14:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 33f13026-21b5-51ce-8e49-01aeae43c353 with identifier: TL32110
2026-03-30 12:14:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 33f13026-21b5-51ce-8e49-01aeae43c353 with identifier: TL32110 to the API
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:51:15Z',
 'fuel_type': 'petrol',
 'id': '33f13026-21b5-51ce-8e49-01aeae43c353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL32110',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 126003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL32110%27 HTTP/1.1" 200 None
2026-03-30 12:14:12 [auto1.nl] INFO: Saving data for TL32110: {'auction_closing_time': 1774972275.0, 'created_time': 1773231967.855925, 'last_price_update_time': 1774872852.807982}
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TL32110') HTTP/1.1" 204 0
2026-03-30 12:14:12 [auto1.nl] INFO: Found listing with ID: BZ97098
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ97098%27 HTTP/1.1" 200 None
2026-03-30 12:14:12 [auto1.nl] INFO: Scrape type for BZ97098: 2
2026-03-30 12:14:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4f0df7c-fe28-567e-8d49-3e0f5244cd8c with identifier: BZ97098
2026-03-30 12:14:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f0df7c-fe28-567e-8d49-3e0f5244cd8c with scrape type 2
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4f0df7c-fe28-567e-8d49-3e0f5244cd8c with scrape type 2
2026-03-30 12:14:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f4f0df7c-fe28-567e-8d49-3e0f5244cd8c, identifier: BZ97098
2026-03-30 12:14:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f4f0df7c-fe28-567e-8d49-3e0f5244cd8c with identifier: BZ97098
2026-03-30 12:14:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f4f0df7c-fe28-567e-8d49-3e0f5244cd8c with identifier: BZ97098
2026-03-30 12:14:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f4f0df7c-fe28-567e-8d49-3e0f5244cd8c with identifier: BZ97098 to the API
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 113,
 'expiration_date': '2026-03-31T15:47:34Z',
 'fuel_type': 'petrol',
 'id': 'f4f0df7c-fe28-567e-8d49-3e0f5244cd8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ97098',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 229700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-24',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.6 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2009}
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ97098%27 HTTP/1.1" 200 None
2026-03-30 12:14:13 [auto1.nl] INFO: Saving data for BZ97098: {'auction_closing_time': 1774972054.0, 'created_time': 1773775074.945175, 'last_price_update_time': 1774872853.25058}
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ97098') HTTP/1.1" 204 0
2026-03-30 12:14:13 [auto1.nl] INFO: Found listing with ID: NH87974
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH87974%27 HTTP/1.1" 200 None
2026-03-30 12:14:13 [auto1.nl] INFO: Scrape type for NH87974: 2
2026-03-30 12:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2266380-2fea-5c69-9759-dfe5abb86015 with identifier: NH87974
2026-03-30 12:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2266380-2fea-5c69-9759-dfe5abb86015 with scrape type 2
2026-03-30 12:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2266380-2fea-5c69-9759-dfe5abb86015 with scrape type 2
2026-03-30 12:14:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2266380-2fea-5c69-9759-dfe5abb86015, identifier: NH87974
2026-03-30 12:14:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2266380-2fea-5c69-9759-dfe5abb86015 with identifier: NH87974
2026-03-30 12:14:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2266380-2fea-5c69-9759-dfe5abb86015 with identifier: NH87974
2026-03-30 12:14:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2266380-2fea-5c69-9759-dfe5abb86015 with identifier: NH87974 to the API
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:21:20Z',
 'fuel_type': 'diesel',
 'id': 'd2266380-2fea-5c69-9759-dfe5abb86015',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH87974',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 199141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-31',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDE FT 260',
 'transmission': 'manual',
 'trim': 'FT 260',
 'year': 2005}
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH87974%27 HTTP/1.1" 200 None
2026-03-30 12:14:13 [auto1.nl] INFO: Saving data for NH87974: {'auction_closing_time': 1774970480.0, 'created_time': 1773231874.666772, 'last_price_update_time': 1774872853.699862}
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NH87974') HTTP/1.1" 204 0
2026-03-30 12:14:13 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-30 12:14:13 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB66825%27 HTTP/1.1" 200 None
2026-03-30 12:14:13 [auto1.nl] INFO: Scrape type for ZB66825: 2
2026-03-30 12:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d5015a4-866a-52b4-bcc4-9f60141b03cc with identifier: ZB66825
2026-03-30 12:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5015a4-866a-52b4-bcc4-9f60141b03cc with scrape type 2
2026-03-30 12:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d5015a4-866a-52b4-bcc4-9f60141b03cc with scrape type 2
2026-03-30 12:14:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d5015a4-866a-52b4-bcc4-9f60141b03cc, identifier: ZB66825
2026-03-30 12:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF57152/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d5015a4-866a-52b4-bcc4-9f60141b03cc with identifier: ZB66825
2026-03-30 12:14:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d5015a4-866a-52b4-bcc4-9f60141b03cc with identifier: ZB66825
2026-03-30 12:14:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d5015a4-866a-52b4-bcc4-9f60141b03cc with identifier: ZB66825 to the API
2026-03-30 12:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:12:43Z',
 'fuel_type': 'petrol',
 'id': '7d5015a4-866a-52b4-bcc4-9f60141b03cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB66825',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 239793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-05',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 12:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB66825%27 HTTP/1.1" 200 None
2026-03-30 12:14:14 [auto1.nl] INFO: Saving data for ZB66825: {'auction_closing_time': 1774969963.0, 'created_time': 1774465392.882373, 'last_price_update_time': 1774872854.724967}
2026-03-30 12:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZB66825') HTTP/1.1" 204 0
2026-03-30 12:14:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:14 [auto1.nl] INFO: Found listing with ID: UX71123
2026-03-30 12:14:14 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-30 12:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC58229%27 HTTP/1.1" 200 None
2026-03-30 12:14:14 [auto1.nl] INFO: Scrape type for KC58229: 2
2026-03-30 12:14:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3de8ea18-8590-5418-81a7-d87b669a0a49 with identifier: KC58229
2026-03-30 12:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3de8ea18-8590-5418-81a7-d87b669a0a49 with scrape type 2
2026-03-30 12:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3de8ea18-8590-5418-81a7-d87b669a0a49 with scrape type 2
2026-03-30 12:14:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3de8ea18-8590-5418-81a7-d87b669a0a49, identifier: KC58229
2026-03-30 12:14:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3de8ea18-8590-5418-81a7-d87b669a0a49 with identifier: KC58229
2026-03-30 12:14:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3de8ea18-8590-5418-81a7-d87b669a0a49 with identifier: KC58229
2026-03-30 12:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3de8ea18-8590-5418-81a7-d87b669a0a49 with identifier: KC58229 to the API
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:17:50Z',
 'fuel_type': 'petrol',
 'id': '3de8ea18-8590-5418-81a7-d87b669a0a49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC58229',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 221126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-21',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TGI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC58229%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [auto1.nl] INFO: Saving data for KC58229: {'auction_closing_time': 1774970270.0, 'created_time': 1774440047.522987, 'last_price_update_time': 1774872855.288241}
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC58229') HTTP/1.1" 204 0
2026-03-30 12:14:15 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS40359%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [auto1.nl] INFO: Scrape type for HS40359: 2
2026-03-30 12:14:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab09278-e469-595e-bf43-42f8fb56ee8a with identifier: HS40359
2026-03-30 12:14:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab09278-e469-595e-bf43-42f8fb56ee8a with scrape type 2
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab09278-e469-595e-bf43-42f8fb56ee8a with scrape type 2
2026-03-30 12:14:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8ab09278-e469-595e-bf43-42f8fb56ee8a, identifier: HS40359
2026-03-30 12:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX69728/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8ab09278-e469-595e-bf43-42f8fb56ee8a with identifier: HS40359
2026-03-30 12:14:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8ab09278-e469-595e-bf43-42f8fb56ee8a with identifier: HS40359
2026-03-30 12:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8ab09278-e469-595e-bf43-42f8fb56ee8a with identifier: HS40359 to the API
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:32:56Z',
 'fuel_type': 'petrol',
 'id': '8ab09278-e469-595e-bf43-42f8fb56ee8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS40359',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 144498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS40359%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [auto1.nl] INFO: Saving data for HS40359: {'auction_closing_time': 1774971176.0, 'created_time': 1774465386.378716, 'last_price_update_time': 1774872855.768108}
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HS40359') HTTP/1.1" 204 0
2026-03-30 12:14:15 [auto1.nl] INFO: Found listing with ID: SV58198
2026-03-30 12:14:15 [auto1.nl] INFO: Found listing with ID: RA55443
2026-03-30 12:14:15 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-30 12:14:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:16 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 1027 | hits on page: 40
2026-03-30 12:14:16 [auto1.nl] INFO: Found listing with ID: AK57667
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK57667%27 HTTP/1.1" 200 None
2026-03-30 12:14:16 [auto1.nl] INFO: Scrape type for AK57667: 2
2026-03-30 12:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd9f436c-103e-5a53-8b58-604cf22866ca with identifier: AK57667
2026-03-30 12:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd9f436c-103e-5a53-8b58-604cf22866ca with scrape type 2
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd9f436c-103e-5a53-8b58-604cf22866ca with scrape type 2
2026-03-30 12:14:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bd9f436c-103e-5a53-8b58-604cf22866ca, identifier: AK57667
2026-03-30 12:14:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bd9f436c-103e-5a53-8b58-604cf22866ca with identifier: AK57667
2026-03-30 12:14:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bd9f436c-103e-5a53-8b58-604cf22866ca with identifier: AK57667
2026-03-30 12:14:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bd9f436c-103e-5a53-8b58-604cf22866ca with identifier: AK57667 to the API
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:33:39Z',
 'fuel_type': 'petrol',
 'id': 'bd9f436c-103e-5a53-8b58-604cf22866ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK57667',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 65447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-13',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK57667%27 HTTP/1.1" 200 None
2026-03-30 12:14:17 [auto1.nl] INFO: Saving data for AK57667: {'auction_closing_time': 1774971219.0, 'created_time': 1773131908.546227, 'last_price_update_time': 1774872857.296641}
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AK57667') HTTP/1.1" 204 0
2026-03-30 12:14:17 [auto1.nl] INFO: Found listing with ID: DD20442
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD20442%27 HTTP/1.1" 200 None
2026-03-30 12:14:17 [auto1.nl] INFO: Scrape type for DD20442: 2
2026-03-30 12:14:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a9030b-cf34-5001-abbe-148dc0f33286 with identifier: DD20442
2026-03-30 12:14:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a9030b-cf34-5001-abbe-148dc0f33286 with scrape type 2
2026-03-30 12:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7a9030b-cf34-5001-abbe-148dc0f33286 with scrape type 2
2026-03-30 12:14:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c7a9030b-cf34-5001-abbe-148dc0f33286, identifier: DD20442
2026-03-30 12:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c7a9030b-cf34-5001-abbe-148dc0f33286 with identifier: DD20442
2026-03-30 12:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c7a9030b-cf34-5001-abbe-148dc0f33286 with identifier: DD20442
2026-03-30 12:14:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c7a9030b-cf34-5001-abbe-148dc0f33286 with identifier: DD20442 to the API
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:41:26Z',
 'fuel_type': 'petrol',
 'id': 'c7a9030b-cf34-5001-abbe-148dc0f33286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD20442',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 133501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-03',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD20442%27 HTTP/1.1" 200 None
2026-03-30 12:14:17 [auto1.nl] INFO: Saving data for DD20442: {'auction_closing_time': 1774971686.0, 'created_time': 1773947007.797443, 'last_price_update_time': 1774872857.791318}
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DD20442') HTTP/1.1" 204 0
2026-03-30 12:14:17 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU17435%27 HTTP/1.1" 200 None
2026-03-30 12:14:17 [auto1.nl] INFO: Scrape type for BU17435: 2
2026-03-30 12:14:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd18abc1-90be-53b8-85e6-ece85a6b176f with identifier: BU17435
2026-03-30 12:14:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd18abc1-90be-53b8-85e6-ece85a6b176f with scrape type 2
2026-03-30 12:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd18abc1-90be-53b8-85e6-ece85a6b176f with scrape type 2
2026-03-30 12:14:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd18abc1-90be-53b8-85e6-ece85a6b176f, identifier: BU17435
2026-03-30 12:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd18abc1-90be-53b8-85e6-ece85a6b176f with identifier: BU17435
2026-03-30 12:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd18abc1-90be-53b8-85e6-ece85a6b176f with identifier: BU17435
2026-03-30 12:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd18abc1-90be-53b8-85e6-ece85a6b176f with identifier: BU17435 to the API
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:31:29Z',
 'fuel_type': 'petrol',
 'id': 'cd18abc1-90be-53b8-85e6-ece85a6b176f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU17435',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 88809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU17435%27 HTTP/1.1" 200 None
2026-03-30 12:14:18 [auto1.nl] INFO: Saving data for BU17435: {'auction_closing_time': 1774971089.0, 'created_time': 1774465417.174777, 'last_price_update_time': 1774872858.264946}
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU17435') HTTP/1.1" 204 0
2026-03-30 12:14:18 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-30 12:14:18 [auto1.nl] INFO: Scrape type for VW91946: 2
2026-03-30 12:14:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946
2026-03-30 12:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c34f38d-62c3-5f02-a8b4-02aed503c9da with scrape type 2
2026-03-30 12:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c34f38d-62c3-5f02-a8b4-02aed503c9da with scrape type 2
2026-03-30 12:14:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5c34f38d-62c3-5f02-a8b4-02aed503c9da, identifier: VW91946
2026-03-30 12:14:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946
2026-03-30 12:14:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946
2026-03-30 12:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946 to the API
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:21:33Z',
 'fuel_type': 'petrol',
 'id': '5c34f38d-62c3-5f02-a8b4-02aed503c9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW91946',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 48295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.4 TCe Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2011}
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-30 12:14:19 [auto1.nl] INFO: Saving data for VW91946: {'auction_closing_time': 1774970493.0, 'created_time': 1773687674.659382, 'last_price_update_time': 1774872859.000638}
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VW91946') HTTP/1.1" 204 0
2026-03-30 12:14:19 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-30 12:14:19 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW09535%27 HTTP/1.1" 200 None
2026-03-30 12:14:19 [auto1.nl] INFO: Scrape type for RW09535: 2
2026-03-30 12:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc4fc64-35a8-5500-90ea-8dcf35817f24 with identifier: RW09535
2026-03-30 12:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc4fc64-35a8-5500-90ea-8dcf35817f24 with scrape type 2
2026-03-30 12:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddc4fc64-35a8-5500-90ea-8dcf35817f24 with scrape type 2
2026-03-30 12:14:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ddc4fc64-35a8-5500-90ea-8dcf35817f24, identifier: RW09535
2026-03-30 12:14:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ddc4fc64-35a8-5500-90ea-8dcf35817f24 with identifier: RW09535
2026-03-30 12:14:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ddc4fc64-35a8-5500-90ea-8dcf35817f24 with identifier: RW09535
2026-03-30 12:14:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ddc4fc64-35a8-5500-90ea-8dcf35817f24 with identifier: RW09535 to the API
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:34:55Z',
 'fuel_type': 'petrol',
 'id': 'ddc4fc64-35a8-5500-90ea-8dcf35817f24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW09535',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 158989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW09535%27 HTTP/1.1" 200 None
2026-03-30 12:14:19 [auto1.nl] INFO: Saving data for RW09535: {'auction_closing_time': 1774971295.0, 'created_time': 1774465386.063832, 'last_price_update_time': 1774872859.544572}
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RW09535') HTTP/1.1" 204 0
2026-03-30 12:14:19 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-30 12:14:19 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PW38124%27 HTTP/1.1" 200 None
2026-03-30 12:14:19 [auto1.nl] INFO: Scrape type for PW38124: 2
2026-03-30 12:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with identifier: PW38124
2026-03-30 12:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with scrape type 2
2026-03-30 12:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with scrape type 2
2026-03-30 12:14:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e, identifier: PW38124
2026-03-30 12:14:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with identifier: PW38124
2026-03-30 12:14:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with identifier: PW38124
2026-03-30 12:14:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with identifier: PW38124 to the API
2026-03-30 12:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:17:38Z',
 'fuel_type': 'petrol',
 'id': '3239ea9a-d81e-5bd1-853e-5093b44d5e7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW38124',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 138914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PW38124%27 HTTP/1.1" 200 None
2026-03-30 12:14:20 [auto1.nl] INFO: Saving data for PW38124: {'auction_closing_time': 1774970258.0, 'created_time': 1774440075.113639, 'last_price_update_time': 1774872860.167495}
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PW38124') HTTP/1.1" 204 0
2026-03-30 12:14:20 [auto1.nl] INFO: Found listing with ID: GM35453
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM35453%27 HTTP/1.1" 200 None
2026-03-30 12:14:20 [auto1.nl] INFO: Scrape type for GM35453: 2
2026-03-30 12:14:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee42fe49-ed8f-5dc7-89ee-9d4f26cf0348 with identifier: GM35453
2026-03-30 12:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee42fe49-ed8f-5dc7-89ee-9d4f26cf0348 with scrape type 2
2026-03-30 12:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee42fe49-ed8f-5dc7-89ee-9d4f26cf0348 with scrape type 2
2026-03-30 12:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ee42fe49-ed8f-5dc7-89ee-9d4f26cf0348, identifier: GM35453
2026-03-30 12:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ee42fe49-ed8f-5dc7-89ee-9d4f26cf0348 with identifier: GM35453
2026-03-30 12:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ee42fe49-ed8f-5dc7-89ee-9d4f26cf0348 with identifier: GM35453
2026-03-30 12:14:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ee42fe49-ed8f-5dc7-89ee-9d4f26cf0348 with identifier: GM35453 to the API
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:48:26Z',
 'fuel_type': 'petrol',
 'id': 'ee42fe49-ed8f-5dc7-89ee-9d4f26cf0348',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM35453',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 95538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-01',
 'seller_name': None,
 'title': 'Ford Ka 1.3 Duratec Viva',
 'transmission': 'manual',
 'trim': 'Viva',
 'year': 2005}
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM35453%27 HTTP/1.1" 200 None
2026-03-30 12:14:20 [auto1.nl] INFO: Saving data for GM35453: {'auction_closing_time': 1774972106.0, 'created_time': 1774551709.104204, 'last_price_update_time': 1774872860.682882}
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GM35453') HTTP/1.1" 204 0
2026-03-30 12:14:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.016(s), this was the 1st time calling it.
2026-03-30 12:14:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.038025908675211 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:20 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-30 12:14:20 [auto1.nl] INFO: Found listing with ID: BC58597
2026-03-30 12:14:20 [auto1.nl] INFO: Found listing with ID: ML05704
2026-03-30 12:14:20 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-30 12:14:20 [auto1.nl] INFO: Scrape type for YF67230: 2
2026-03-30 12:14:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efefaf2c-d624-5bc1-b953-7e9dc937a9da with identifier: YF67230
2026-03-30 12:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efefaf2c-d624-5bc1-b953-7e9dc937a9da with scrape type 2
2026-03-30 12:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efefaf2c-d624-5bc1-b953-7e9dc937a9da with scrape type 2
2026-03-30 12:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: efefaf2c-d624-5bc1-b953-7e9dc937a9da, identifier: YF67230
2026-03-30 12:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF57152> (referer: https://www.auto1.com/v1/car-details-view/LF57152/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: efefaf2c-d624-5bc1-b953-7e9dc937a9da with identifier: YF67230
2026-03-30 12:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: efefaf2c-d624-5bc1-b953-7e9dc937a9da with identifier: YF67230
2026-03-30 12:14:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: efefaf2c-d624-5bc1-b953-7e9dc937a9da with identifier: YF67230 to the API
2026-03-30 12:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:28:39Z',
 'fuel_type': 'diesel',
 'id': 'efefaf2c-d624-5bc1-b953-7e9dc937a9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF67230',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 225265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'BMW X3 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-30 12:14:21 [auto1.nl] INFO: Saving data for YF67230: {'auction_closing_time': 1774970919.0, 'created_time': 1773229431.62868, 'last_price_update_time': 1774872861.196886}
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YF67230') HTTP/1.1" 204 0
2026-03-30 12:14:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:21 [auto1.nl] INFO: Found listing with ID: DW60052
2026-03-30 12:14:21 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-30 12:14:21 [auto1.nl] INFO: Found listing with ID: HZ42118
2026-03-30 12:14:21 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG03602%27 HTTP/1.1" 200 None
2026-03-30 12:14:21 [auto1.nl] INFO: Scrape type for TG03602: 2
2026-03-30 12:14:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9aa66a5-e319-5cd5-b472-73d349d91761 with identifier: TG03602
2026-03-30 12:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9aa66a5-e319-5cd5-b472-73d349d91761 with scrape type 2
2026-03-30 12:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9aa66a5-e319-5cd5-b472-73d349d91761 with scrape type 2
2026-03-30 12:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f9aa66a5-e319-5cd5-b472-73d349d91761, identifier: TG03602
2026-03-30 12:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f9aa66a5-e319-5cd5-b472-73d349d91761 with identifier: TG03602
2026-03-30 12:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f9aa66a5-e319-5cd5-b472-73d349d91761 with identifier: TG03602
2026-03-30 12:14:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f9aa66a5-e319-5cd5-b472-73d349d91761 with identifier: TG03602 to the API
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:35:07Z',
 'fuel_type': 'petrol',
 'id': 'f9aa66a5-e319-5cd5-b472-73d349d91761',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG03602',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 147743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2012}
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG03602%27 HTTP/1.1" 200 None
2026-03-30 12:14:21 [auto1.nl] INFO: Saving data for TG03602: {'auction_closing_time': 1774971307.0, 'created_time': 1774465263.366845, 'last_price_update_time': 1774872861.688985}
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TG03602') HTTP/1.1" 204 0
2026-03-30 12:14:21 [auto1.nl] INFO: Found listing with ID: VF41372
2026-03-30 12:14:21 [auto1.nl] INFO: Found listing with ID: JY08621
2026-03-30 12:14:21 [auto1.nl] INFO: Found listing with ID: KB54920
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB54920%27 HTTP/1.1" 200 None
2026-03-30 12:14:21 [auto1.nl] INFO: Scrape type for KB54920: 2
2026-03-30 12:14:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a84adfe-36ca-545c-a7f1-f02bef1bc47d with identifier: KB54920
2026-03-30 12:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a84adfe-36ca-545c-a7f1-f02bef1bc47d with scrape type 2
2026-03-30 12:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a84adfe-36ca-545c-a7f1-f02bef1bc47d with scrape type 2
2026-03-30 12:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5a84adfe-36ca-545c-a7f1-f02bef1bc47d, identifier: KB54920
2026-03-30 12:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5a84adfe-36ca-545c-a7f1-f02bef1bc47d with identifier: KB54920
2026-03-30 12:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5a84adfe-36ca-545c-a7f1-f02bef1bc47d with identifier: KB54920
2026-03-30 12:14:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5a84adfe-36ca-545c-a7f1-f02bef1bc47d with identifier: KB54920 to the API
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:14:41Z',
 'fuel_type': 'petrol',
 'id': '5a84adfe-36ca-545c-a7f1-f02bef1bc47d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB54920',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 236986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-10',
 'seller_name': None,
 'title': 'Peugeot 307 2.0 SW Grand Filou Cool',
 'transmission': 'manual',
 'trim': 'SW Grand Filou Cool',
 'year': 2007}
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB54920%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [auto1.nl] INFO: Saving data for KB54920: {'auction_closing_time': 1774970081.0, 'created_time': 1774292541.434542, 'last_price_update_time': 1774872862.331562}
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB54920') HTTP/1.1" 204 0
2026-03-30 12:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f91ab67f-b911-5e00-8509-f5f09266ac5a with identifier: LF57152
2026-03-30 12:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f91ab67f-b911-5e00-8509-f5f09266ac5a with scrape type 1
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f91ab67f-b911-5e00-8509-f5f09266ac5a
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_17dd7b703ec0e1b3c06d5a49011d8062.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_17dd7b703ec0e1b3c06d5a49011d8062.jpg already downloaded
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_4434f4fd2283cf5d5599bc674431bec5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_4434f4fd2283cf5d5599bc674431bec5.jpg already downloaded
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_1b8320328e3256459b4197cb8eec0872.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_1b8320328e3256459b4197cb8eec0872.jpg already downloaded
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_5f1920a4a4cbce2ad4d4214757ae3df3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_5f1920a4a4cbce2ad4d4214757ae3df3.jpg already downloaded
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_b1b699a1f7cc087702f45fa264f8a9ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_b1b699a1f7cc087702f45fa264f8a9ee.jpg already downloaded
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_4dca55f68eb209682a7869e7f6ec44bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_4dca55f68eb209682a7869e7f6ec44bb.jpg already downloaded
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_abb97d9c65750cbbb2eddf07a49ee4bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_abb97d9c65750cbbb2eddf07a49ee4bd.jpg already downloaded
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_29e353a474007e164b48e36c5097ed4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_29e353a474007e164b48e36c5097ed4c.jpg already downloaded
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_f2ec90d6e2e1b0ad6a60fee35350851f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_f2ec90d6e2e1b0ad6a60fee35350851f.jpg already downloaded
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fba%252Fe3ba324581d65e7bd4a0b6b57b1ca873%252Fpa%252FLF57152_b36444b2e095bdea1b996f5be764ebde.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_b36444b2e095bdea1b996f5be764ebde.jpg already downloaded
2026-03-30 12:14:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f91ab67f-b911-5e00-8509-f5f09266ac5a, identifier: LF57152
2026-03-30 12:14:22 [auto1.nl] INFO: Found listing with ID: CR62554
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR62554%27 HTTP/1.1" 200 None
2026-03-30 12:14:22 [auto1.nl] INFO: Scrape type for CR62554: 2
2026-03-30 12:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a47f6070-273c-5c99-9824-959aa3744331 with identifier: CR62554
2026-03-30 12:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a47f6070-273c-5c99-9824-959aa3744331 with scrape type 2
2026-03-30 12:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a47f6070-273c-5c99-9824-959aa3744331 with scrape type 2
2026-03-30 12:14:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a47f6070-273c-5c99-9824-959aa3744331, identifier: CR62554
2026-03-30 12:14:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f91ab67f-b911-5e00-8509-f5f09266ac5a with identifier: LF57152
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 12:14:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:14:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f91ab67f-b911-5e00-8509-f5f09266ac5a with identifier: LF57152
2026-03-30 12:14:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f91ab67f-b911-5e00-8509-f5f09266ac5a with identifier: LF57152 to the API
2026-03-30 12:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LF57152>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:44:30Z',
 'fuel_type': 'petrol',
 'id': 'f91ab67f-b911-5e00-8509-f5f09266ac5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SJ294H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF57152',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 30688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_17dd7b703ec0e1b3c06d5a49011d8062.jpg',
                'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_4434f4fd2283cf5d5599bc674431bec5.jpg',
                'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_1b8320328e3256459b4197cb8eec0872.jpg',
                'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_5f1920a4a4cbce2ad4d4214757ae3df3.jpg',
                'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_b1b699a1f7cc087702f45fa264f8a9ee.jpg',
                'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_4dca55f68eb209682a7869e7f6ec44bb.jpg',
                'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_abb97d9c65750cbbb2eddf07a49ee4bd.jpg',
                'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_29e353a474007e164b48e36c5097ed4c.jpg',
                'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_f2ec90d6e2e1b0ad6a60fee35350851f.jpg',
                'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_b36444b2e095bdea1b996f5be764ebde.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2154067,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_17dd7b703ec0e1b3c06d5a49011d8062.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_4434f4fd2283cf5d5599bc674431bec5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_1b8320328e3256459b4197cb8eec0872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_5f1920a4a4cbce2ad4d4214757ae3df3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2173253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_b1b699a1f7cc087702f45fa264f8a9ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2175062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_4dca55f68eb209682a7869e7f6ec44bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1926796,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_abb97d9c65750cbbb2eddf07a49ee4bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2156500,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_29e353a474007e164b48e36c5097ed4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_f2ec90d6e2e1b0ad6a60fee35350851f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f91ab67f-b911-5e00-8509-f5f09266ac5a/f91ab67f-b911-5e00-8509-f5f09266ac5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ba/e3ba324581d65e7bd4a0b6b57b1ca873/pa/LF57152_b36444b2e095bdea1b996f5be764ebde.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0 VTi Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2018}
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF57152%27 HTTP/1.1" 200 None
2026-03-30 12:14:24 [auto1.nl] INFO: Saving data for LF57152: {'created_time': 1774872864.37949, 'last_price_update_time': 1774872864.3795, 'auction_closing_time': 1774971870.0}
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF57152') HTTP/1.1" 204 0
2026-03-30 12:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a47f6070-273c-5c99-9824-959aa3744331 with identifier: CR62554
2026-03-30 12:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a47f6070-273c-5c99-9824-959aa3744331 with identifier: CR62554
2026-03-30 12:14:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a47f6070-273c-5c99-9824-959aa3744331 with identifier: CR62554 to the API
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:38:20Z',
 'fuel_type': 'petrol',
 'id': 'a47f6070-273c-5c99-9824-959aa3744331',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR62554',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 276848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-13',
 'seller_name': None,
 'title': 'Ford S-Max 2.5 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2007}
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR62554%27 HTTP/1.1" 200 None
2026-03-30 12:14:24 [auto1.nl] INFO: Saving data for CR62554: {'auction_closing_time': 1774971500.0, 'created_time': 1773229272.653904, 'last_price_update_time': 1774872864.782477}
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR62554') HTTP/1.1" 204 0
2026-03-30 12:14:24 [auto1.nl] INFO: Found listing with ID: LE06862
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06862%27 HTTP/1.1" 200 None
2026-03-30 12:14:24 [auto1.nl] INFO: Scrape type for LE06862: 2
2026-03-30 12:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dee5ad06-1ccd-5ce3-a1c3-dded74693993 with identifier: LE06862
2026-03-30 12:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dee5ad06-1ccd-5ce3-a1c3-dded74693993 with scrape type 2
2026-03-30 12:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dee5ad06-1ccd-5ce3-a1c3-dded74693993 with scrape type 2
2026-03-30 12:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dee5ad06-1ccd-5ce3-a1c3-dded74693993, identifier: LE06862
2026-03-30 12:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dee5ad06-1ccd-5ce3-a1c3-dded74693993 with identifier: LE06862
2026-03-30 12:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dee5ad06-1ccd-5ce3-a1c3-dded74693993 with identifier: LE06862
2026-03-30 12:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dee5ad06-1ccd-5ce3-a1c3-dded74693993 with identifier: LE06862 to the API
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-31T15:36:52Z',
 'fuel_type': 'petrol',
 'id': 'dee5ad06-1ccd-5ce3-a1c3-dded74693993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE06862',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 163075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06862%27 HTTP/1.1" 200 None
2026-03-30 12:14:25 [auto1.nl] INFO: Saving data for LE06862: {'auction_closing_time': 1774971412.0, 'created_time': 1773229338.13393, 'last_price_update_time': 1774872865.268434}
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LE06862') HTTP/1.1" 204 0
2026-03-30 12:14:25 [auto1.nl] INFO: Found listing with ID: LJ21279
2026-03-30 12:14:25 [auto1.nl] INFO: Found listing with ID: SL25522
2026-03-30 12:14:25 [auto1.nl] INFO: Found listing with ID: GX31648
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX31648%27 HTTP/1.1" 200 None
2026-03-30 12:14:25 [auto1.nl] INFO: Scrape type for GX31648: 2
2026-03-30 12:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef49070-0449-5158-9242-96de405c3ed9 with identifier: GX31648
2026-03-30 12:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef49070-0449-5158-9242-96de405c3ed9 with scrape type 2
2026-03-30 12:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ef49070-0449-5158-9242-96de405c3ed9 with scrape type 2
2026-03-30 12:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5ef49070-0449-5158-9242-96de405c3ed9, identifier: GX31648
2026-03-30 12:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5ef49070-0449-5158-9242-96de405c3ed9 with identifier: GX31648
2026-03-30 12:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5ef49070-0449-5158-9242-96de405c3ed9 with identifier: GX31648
2026-03-30 12:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5ef49070-0449-5158-9242-96de405c3ed9 with identifier: GX31648 to the API
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:48:00Z',
 'fuel_type': 'petrol',
 'id': '5ef49070-0449-5158-9242-96de405c3ed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX31648',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 191444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-03',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX31648%27 HTTP/1.1" 200 None
2026-03-30 12:14:25 [auto1.nl] INFO: Saving data for GX31648: {'auction_closing_time': 1774972080.0, 'created_time': 1774267313.221504, 'last_price_update_time': 1774872865.786319}
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GX31648') HTTP/1.1" 204 0
2026-03-30 12:14:25 [auto1.nl] INFO: Found listing with ID: DA24355
2026-03-30 12:14:25 [auto1.nl] INFO: Found listing with ID: FZ81296
2026-03-30 12:14:25 [auto1.nl] INFO: Found listing with ID: CV38071
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV38071%27 HTTP/1.1" 200 None
2026-03-30 12:14:25 [auto1.nl] INFO: Scrape type for CV38071: 2
2026-03-30 12:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8df012f7-8335-59b1-88d8-ded808e7bb39 with identifier: CV38071
2026-03-30 12:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8df012f7-8335-59b1-88d8-ded808e7bb39 with scrape type 2
2026-03-30 12:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8df012f7-8335-59b1-88d8-ded808e7bb39 with scrape type 2
2026-03-30 12:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8df012f7-8335-59b1-88d8-ded808e7bb39, identifier: CV38071
2026-03-30 12:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8df012f7-8335-59b1-88d8-ded808e7bb39 with identifier: CV38071
2026-03-30 12:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8df012f7-8335-59b1-88d8-ded808e7bb39 with identifier: CV38071
2026-03-30 12:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8df012f7-8335-59b1-88d8-ded808e7bb39 with identifier: CV38071 to the API
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:51:39Z',
 'fuel_type': 'petrol',
 'id': '8df012f7-8335-59b1-88d8-ded808e7bb39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV38071',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 241680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2003}
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV38071%27 HTTP/1.1" 200 None
2026-03-30 12:14:26 [auto1.nl] INFO: Saving data for CV38071: {'auction_closing_time': 1774972299.0, 'created_time': 1774292583.338461, 'last_price_update_time': 1774872866.380902}
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CV38071') HTTP/1.1" 204 0
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: JZ36461
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: NT74232
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: UZ08221
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: BP54166
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: EJ03630
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ03630%27 HTTP/1.1" 200 None
2026-03-30 12:14:26 [auto1.nl] INFO: Scrape type for EJ03630: 1
2026-03-30 12:14:26 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR95179%27 HTTP/1.1" 200 None
2026-03-30 12:14:26 [auto1.nl] INFO: Scrape type for NR95179: 2
2026-03-30 12:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ce33b9-179a-55c2-b445-fa3538e6dc64 with identifier: NR95179
2026-03-30 12:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ce33b9-179a-55c2-b445-fa3538e6dc64 with scrape type 2
2026-03-30 12:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8ce33b9-179a-55c2-b445-fa3538e6dc64 with scrape type 2
2026-03-30 12:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e8ce33b9-179a-55c2-b445-fa3538e6dc64, identifier: NR95179
2026-03-30 12:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e8ce33b9-179a-55c2-b445-fa3538e6dc64 with identifier: NR95179
2026-03-30 12:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e8ce33b9-179a-55c2-b445-fa3538e6dc64 with identifier: NR95179
2026-03-30 12:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e8ce33b9-179a-55c2-b445-fa3538e6dc64 with identifier: NR95179 to the API
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:49:59Z',
 'fuel_type': 'petrol',
 'id': 'e8ce33b9-179a-55c2-b445-fa3538e6dc64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR95179',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 66453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-28',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 THP Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2010}
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR95179%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [auto1.nl] INFO: Saving data for NR95179: {'auction_closing_time': 1774972199.0, 'created_time': 1773135022.096805, 'last_price_update_time': 1774872867.09298}
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NR95179') HTTP/1.1" 204 0
2026-03-30 12:14:27 [auto1.nl] INFO: Found listing with ID: TG38127
2026-03-30 12:14:27 [auto1.nl] INFO: Found listing with ID: WH88048
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH88048%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [auto1.nl] INFO: Scrape type for WH88048: 2
2026-03-30 12:14:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cf07574-a32d-561f-88e6-0d71b9ea6231 with identifier: WH88048
2026-03-30 12:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf07574-a32d-561f-88e6-0d71b9ea6231 with scrape type 2
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cf07574-a32d-561f-88e6-0d71b9ea6231 with scrape type 2
2026-03-30 12:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2cf07574-a32d-561f-88e6-0d71b9ea6231, identifier: WH88048
2026-03-30 12:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2cf07574-a32d-561f-88e6-0d71b9ea6231 with identifier: WH88048
2026-03-30 12:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2cf07574-a32d-561f-88e6-0d71b9ea6231 with identifier: WH88048
2026-03-30 12:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2cf07574-a32d-561f-88e6-0d71b9ea6231 with identifier: WH88048 to the API
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:51:49Z',
 'fuel_type': 'petrol',
 'id': '2cf07574-a32d-561f-88e6-0d71b9ea6231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH88048',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 115667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-14',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2015}
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH88048%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [auto1.nl] INFO: Saving data for WH88048: {'auction_closing_time': 1774972309.0, 'created_time': 1774267351.88615, 'last_price_update_time': 1774872867.725077}
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WH88048') HTTP/1.1" 204 0
2026-03-30 12:14:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA42308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL69389> (referer: https://www.auto1.com/v1/car-details-view/PL69389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9afa1135-5dbe-5641-a643-a1b2afc558e1 with identifier: PL69389
2026-03-30 12:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9afa1135-5dbe-5641-a643-a1b2afc558e1 with scrape type 1
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9afa1135-5dbe-5641-a643-a1b2afc558e1
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_e28f9eb9216cd5b7a070dffdf5054113.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_e28f9eb9216cd5b7a070dffdf5054113.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_7ae98c5dd51b491bf0cf7db1d6764007.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_7ae98c5dd51b491bf0cf7db1d6764007.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_d2a5e4adad0a21fbf9e43f07627afca0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_d2a5e4adad0a21fbf9e43f07627afca0.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_be6af5e6382981c6a0d76dea7abbd50a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_be6af5e6382981c6a0d76dea7abbd50a.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_490848acbde04da8a5aa4781aac0a22a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_490848acbde04da8a5aa4781aac0a22a.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_8f6780379f3e3c68e383267666e460c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_8f6780379f3e3c68e383267666e460c9.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_a97985b36a7345327e614dd54e78cdaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_a97985b36a7345327e614dd54e78cdaf.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_ae79bf85d0f30f27cc0539b2eb4bbc69.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_ae79bf85d0f30f27cc0539b2eb4bbc69.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_6b122cc8433f5ce2d2051aa017b0b864.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_6b122cc8433f5ce2d2051aa017b0b864.jpg already downloaded
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F98%252Fce98e4553f3a127d75a7018d9689876b%252Fpa%252FPL69389_b7d2341f2ad522ada238a23cfa17e78b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_b7d2341f2ad522ada238a23cfa17e78b.jpg already downloaded
2026-03-30 12:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9afa1135-5dbe-5641-a643-a1b2afc558e1, identifier: PL69389
2026-03-30 12:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9afa1135-5dbe-5641-a643-a1b2afc558e1 with identifier: PL69389
2026-03-30 12:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9afa1135-5dbe-5641-a643-a1b2afc558e1 with identifier: PL69389
2026-03-30 12:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9afa1135-5dbe-5641-a643-a1b2afc558e1 with identifier: PL69389 to the API
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PL69389>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:03:06Z',
 'fuel_type': 'diesel',
 'id': '9afa1135-5dbe-5641-a643-a1b2afc558e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PB953N',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL69389',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '5er',
 'odometer': 206487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_e28f9eb9216cd5b7a070dffdf5054113.jpg',
                'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_7ae98c5dd51b491bf0cf7db1d6764007.jpg',
                'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_d2a5e4adad0a21fbf9e43f07627afca0.jpg',
                'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_be6af5e6382981c6a0d76dea7abbd50a.jpg',
                'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_490848acbde04da8a5aa4781aac0a22a.jpg',
                'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_8f6780379f3e3c68e383267666e460c9.jpg',
                'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_a97985b36a7345327e614dd54e78cdaf.jpg',
                'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_ae79bf85d0f30f27cc0539b2eb4bbc69.jpg',
                'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_6b122cc8433f5ce2d2051aa017b0b864.jpg',
                'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_b7d2341f2ad522ada238a23cfa17e78b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_e28f9eb9216cd5b7a070dffdf5054113.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514955,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_7ae98c5dd51b491bf0cf7db1d6764007.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_d2a5e4adad0a21fbf9e43f07627afca0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577385,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_be6af5e6382981c6a0d76dea7abbd50a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578256,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_490848acbde04da8a5aa4781aac0a22a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_8f6780379f3e3c68e383267666e460c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_a97985b36a7345327e614dd54e78cdaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612865,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_ae79bf85d0f30f27cc0539b2eb4bbc69.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_6b122cc8433f5ce2d2051aa017b0b864.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9afa1135-5dbe-5641-a643-a1b2afc558e1/9afa1135-5dbe-5641-a643-a1b2afc558e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/98/ce98e4553f3a127d75a7018d9689876b/pa/PL69389_b7d2341f2ad522ada238a23cfa17e78b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL69389%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.nl] INFO: Saving data for PL69389: {'created_time': 1774872879.804899, 'last_price_update_time': 1774872879.804909, 'auction_closing_time': 1774969386.0}
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PL69389') HTTP/1.1" 204 0
2026-03-30 12:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX69728> (referer: https://www.auto1.com/v1/car-details-view/TX69728/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 837282b5-ef6c-55d5-9b5e-35f2785adfeb with identifier: TX69728
2026-03-30 12:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837282b5-ef6c-55d5-9b5e-35f2785adfeb with scrape type 1
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 837282b5-ef6c-55d5-9b5e-35f2785adfeb
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_38f0bd7bd8a0c3e4d8fce0deadb7f8f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_38f0bd7bd8a0c3e4d8fce0deadb7f8f2.jpg already downloaded
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_0160e082c786760f961884fac1f3904e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_0160e082c786760f961884fac1f3904e.jpg already downloaded
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_17a20a86887803ee65a6fc91c4667075.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_17a20a86887803ee65a6fc91c4667075.jpg already downloaded
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_65ea9253a50c1a9f909f7d90bca088a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_65ea9253a50c1a9f909f7d90bca088a8.jpg already downloaded
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_1cd76b6293798e86b3c5432867b7b7a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_1cd76b6293798e86b3c5432867b7b7a0.jpg already downloaded
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_b5e134d9c2aa0483f1020fa115180c3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_b5e134d9c2aa0483f1020fa115180c3a.jpg already downloaded
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_6fc53496b941ec962559938ae0aba5c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_6fc53496b941ec962559938ae0aba5c6.jpg already downloaded
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_34e4030a2a6d168d6fd7da3bcaf5a0b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_34e4030a2a6d168d6fd7da3bcaf5a0b6.jpg already downloaded
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_37a46feb33a1e046b9973047b92be4da.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_37a46feb33a1e046b9973047b92be4da.jpg already downloaded
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Ff3%252Ff0f3042c42f11ed6ec8b1ca7d2bfe558%252Fpa%252FTX69728_f16d93c3f9d2d0dd945b3c36b81433f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_f16d93c3f9d2d0dd945b3c36b81433f0.jpg already downloaded
2026-03-30 12:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 837282b5-ef6c-55d5-9b5e-35f2785adfeb, identifier: TX69728
2026-03-30 12:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 837282b5-ef6c-55d5-9b5e-35f2785adfeb with identifier: TX69728
2026-03-30 12:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 837282b5-ef6c-55d5-9b5e-35f2785adfeb with identifier: TX69728
2026-03-30 12:14:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 837282b5-ef6c-55d5-9b5e-35f2785adfeb with identifier: TX69728 to the API
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX69728>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:36:17Z',
 'fuel_type': 'petrol',
 'id': '837282b5-ef6c-55d5-9b5e-35f2785adfeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KB-798-T',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX69728',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 160494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_38f0bd7bd8a0c3e4d8fce0deadb7f8f2.jpg',
                'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_0160e082c786760f961884fac1f3904e.jpg',
                'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_17a20a86887803ee65a6fc91c4667075.jpg',
                'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_65ea9253a50c1a9f909f7d90bca088a8.jpg',
                'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_1cd76b6293798e86b3c5432867b7b7a0.jpg',
                'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_b5e134d9c2aa0483f1020fa115180c3a.jpg',
                'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_6fc53496b941ec962559938ae0aba5c6.jpg',
                'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_34e4030a2a6d168d6fd7da3bcaf5a0b6.jpg',
                'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_37a46feb33a1e046b9973047b92be4da.jpg',
                'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_f16d93c3f9d2d0dd945b3c36b81433f0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_38f0bd7bd8a0c3e4d8fce0deadb7f8f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_0160e082c786760f961884fac1f3904e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_17a20a86887803ee65a6fc91c4667075.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2993997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_65ea9253a50c1a9f909f7d90bca088a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840049,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_1cd76b6293798e86b3c5432867b7b7a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3000957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_b5e134d9c2aa0483f1020fa115180c3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_6fc53496b941ec962559938ae0aba5c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_34e4030a2a6d168d6fd7da3bcaf5a0b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2881340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_37a46feb33a1e046b9973047b92be4da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837282b5-ef6c-55d5-9b5e-35f2785adfeb/837282b5-ef6c-55d5-9b5e-35f2785adfeb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3299759,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/f3/f0f3042c42f11ed6ec8b1ca7d2bfe558/pa/TX69728_f16d93c3f9d2d0dd945b3c36b81433f0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia pro_cee'd 1.0 TGDI GT-Line",
 'transmission': 'manual',
 'trim': 'GT-Line',
 'year': 2016}
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TX69728%27 HTTP/1.1" 200 None
2026-03-30 12:14:41 [auto1.nl] INFO: Saving data for TX69728: {'created_time': 1774872881.42201, 'last_price_update_time': 1774872881.422018, 'auction_closing_time': 1774971377.0}
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TX69728') HTTP/1.1" 204 0
2026-03-30 12:14:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.088(s), this was the 1st time calling it.
2026-03-30 12:14:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.659319079656263 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.249(s), this was the 1st time calling it.
2026-03-30 12:14:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.767263376742599 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW12392> (referer: https://www.auto1.com/v1/car-details-view/LW12392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a596e4f7-f336-5a83-83f9-0993eae5a864 with identifier: LW12392
2026-03-30 12:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a596e4f7-f336-5a83-83f9-0993eae5a864 with scrape type 1
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_ba40ce89cf6c039eafee94a94b283252.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_ba40ce89cf6c039eafee94a94b283252.jpg not downloaded yet
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_abda027851618c91ae0cb127bfdabe3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_abda027851618c91ae0cb127bfdabe3e.jpg not downloaded yet
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_656059ecb553c7108fc49ca64c3b201b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_656059ecb553c7108fc49ca64c3b201b.jpg not downloaded yet
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_592042ec157e74c61c671085547bf411.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_592042ec157e74c61c671085547bf411.jpg not downloaded yet
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_f151d7f56d29c52a5e7cc95ea6ac41e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_f151d7f56d29c52a5e7cc95ea6ac41e6.jpg not downloaded yet
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_65d87c9ac8514a99c59f8ab62df455cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_65d87c9ac8514a99c59f8ab62df455cc.jpg not downloaded yet
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_5e0aff849e367a9af449b6f99aa69a0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_5e0aff849e367a9af449b6f99aa69a0b.jpg not downloaded yet
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_44f7ab35b9c2b0bb35aae37c5786f6c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_44f7ab35b9c2b0bb35aae37c5786f6c7.jpg not downloaded yet
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_710a326144dca04ca08337829e6d1f7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_710a326144dca04ca08337829e6d1f7b.jpg not downloaded yet
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_71de1028607acd0f614573e7397f32d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_71de1028607acd0f614573e7397f32d5.jpg not downloaded yet
2026-03-30 12:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_ba40ce89cf6c039eafee94a94b283252.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_abda027851618c91ae0cb127bfdabe3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_710a326144dca04ca08337829e6d1f7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_71de1028607acd0f614573e7397f32d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_44f7ab35b9c2b0bb35aae37c5786f6c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed24bd0>
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_ba40ce89cf6c039eafee94a94b283252.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_ba40ce89cf6c039eafee94a94b283252.jpg saved to cache
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed10dd0>
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_abda027851618c91ae0cb127bfdabe3e.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_abda027851618c91ae0cb127bfdabe3e.jpg saved to cache
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_656059ecb553c7108fc49ca64c3b201b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed1e790>
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_710a326144dca04ca08337829e6d1f7b.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_710a326144dca04ca08337829e6d1f7b.jpg saved to cache
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee26210>
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_71de1028607acd0f614573e7397f32d5.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_71de1028607acd0f614573e7397f32d5.jpg saved to cache
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75f57c10>
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_44f7ab35b9c2b0bb35aae37c5786f6c7.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_44f7ab35b9c2b0bb35aae37c5786f6c7.jpg saved to cache
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75f55810>
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_656059ecb553c7108fc49ca64c3b201b.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_656059ecb553c7108fc49ca64c3b201b.jpg saved to cache
2026-03-30 12:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_5e0aff849e367a9af449b6f99aa69a0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_f151d7f56d29c52a5e7cc95ea6ac41e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_592042ec157e74c61c671085547bf411.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_65d87c9ac8514a99c59f8ab62df455cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee88150>
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_5e0aff849e367a9af449b6f99aa69a0b.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_5e0aff849e367a9af449b6f99aa69a0b.jpg saved to cache
2026-03-30 12:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74092e50>
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_f151d7f56d29c52a5e7cc95ea6ac41e6.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_f151d7f56d29c52a5e7cc95ea6ac41e6.jpg saved to cache
2026-03-30 12:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74127290>
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_592042ec157e74c61c671085547bf411.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_592042ec157e74c61c671085547bf411.jpg saved to cache
2026-03-30 12:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eebc250>
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F59%252F9b590b7cab70ef4d60d7f6d590c112ee%252Fpa%252FLW12392_65d87c9ac8514a99c59f8ab62df455cc.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_65d87c9ac8514a99c59f8ab62df455cc.jpg saved to cache
2026-03-30 12:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a596e4f7-f336-5a83-83f9-0993eae5a864
2026-03-30 12:14:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a596e4f7-f336-5a83-83f9-0993eae5a864, skipping ID generation
2026-03-30 12:14:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a596e4f7-f336-5a83-83f9-0993eae5a864 with scrape type 1
2026-03-30 12:14:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a596e4f7-f336-5a83-83f9-0993eae5a864 sending to next pipeline
2026-03-30 12:14:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a596e4f7-f336-5a83-83f9-0993eae5a864, identifier: LW12392
2026-03-30 12:14:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a596e4f7-f336-5a83-83f9-0993eae5a864 with identifier: LW12392
2026-03-30 12:14:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a596e4f7-f336-5a83-83f9-0993eae5a864 with identifier: LW12392
2026-03-30 12:14:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a596e4f7-f336-5a83-83f9-0993eae5a864 with identifier: LW12392 to the API
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_65d87c9ac8514a99c59f8ab62df455cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:31:49Z',
 'fuel_type': 'electro',
 'id': 'a596e4f7-f336-5a83-83f9-0993eae5a864',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R818ZJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW12392',
 'listing': 'auction',
 'location': 'NL, Leiderdorp',
 'make': 'Volkswagen',
 'model': 'ID.5',
 'odometer': 36086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_ba40ce89cf6c039eafee94a94b283252.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_abda027851618c91ae0cb127bfdabe3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_656059ecb553c7108fc49ca64c3b201b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1849403,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_592042ec157e74c61c671085547bf411.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2129534,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_f151d7f56d29c52a5e7cc95ea6ac41e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2197817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_65d87c9ac8514a99c59f8ab62df455cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1996225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_5e0aff849e367a9af449b6f99aa69a0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_44f7ab35b9c2b0bb35aae37c5786f6c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_710a326144dca04ca08337829e6d1f7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a596e4f7-f336-5a83-83f9-0993eae5a864/a596e4f7-f336-5a83-83f9-0993eae5a864_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/59/9b590b7cab70ef4d60d7f6d590c112ee/pa/LW12392_71de1028607acd0f614573e7397f32d5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.5 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2022}
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW12392%27 HTTP/1.1" 200 None
2026-03-30 12:14:52 [auto1.nl] INFO: Saving data for LW12392: {'created_time': 1774872892.30006, 'last_price_update_time': 1774872892.300069, 'auction_closing_time': 1774971109.0}
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LW12392') HTTP/1.1" 204 0
2026-03-30 12:15:07 [scrapy.extensions.logstats] INFO: Crawled 125 pages (at 8 pages/min), scraped 118 items (at 34 items/min)
2026-03-30 12:15:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR70834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR70834> (referer: https://www.auto1.com/v1/car-details-view/ZR70834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fcd7925-6feb-5e0f-baea-de68ba43f73f with identifier: ZR70834
2026-03-30 12:15:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f with scrape type 1
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_ea9d33dfec62b71b0ee911f8664ef52f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_ea9d33dfec62b71b0ee911f8664ef52f.jpg not downloaded yet
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_d715527536bd5da7adf0ba807dea2b70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_d715527536bd5da7adf0ba807dea2b70.jpg not downloaded yet
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_bafd4107c7e8803e1c9ab31ccc16276e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_bafd4107c7e8803e1c9ab31ccc16276e.jpg not downloaded yet
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_1bdcf1ddddc333be1e9a330a4758a18a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_1bdcf1ddddc333be1e9a330a4758a18a.jpg not downloaded yet
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_bd86750f4d3cf807cafa735a3f06049c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_bd86750f4d3cf807cafa735a3f06049c.jpg not downloaded yet
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_51ca707716c2e51442d301d8e09b65b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_51ca707716c2e51442d301d8e09b65b4.jpg not downloaded yet
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_3d5805f2f4de1c345cdddc95bf47950f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_3d5805f2f4de1c345cdddc95bf47950f.jpg not downloaded yet
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_f26e3f6176a74ea344493cc1eab3a456.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_f26e3f6176a74ea344493cc1eab3a456.jpg not downloaded yet
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_b77025a9f6db667557098d010723f54a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_b77025a9f6db667557098d010723f54a.jpg not downloaded yet
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_96a4af9c5896015a1f7f9166abd80e7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_96a4af9c5896015a1f7f9166abd80e7b.jpg not downloaded yet
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_d715527536bd5da7adf0ba807dea2b70.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_1bdcf1ddddc333be1e9a330a4758a18a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_ea9d33dfec62b71b0ee911f8664ef52f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_bd86750f4d3cf807cafa735a3f06049c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_51ca707716c2e51442d301d8e09b65b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_bafd4107c7e8803e1c9ab31ccc16276e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_3d5805f2f4de1c345cdddc95bf47950f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b75acc810>
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_d715527536bd5da7adf0ba807dea2b70.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_d715527536bd5da7adf0ba807dea2b70.jpg saved to cache
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_f26e3f6176a74ea344493cc1eab3a456.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b759337d0>
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_1bdcf1ddddc333be1e9a330a4758a18a.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_1bdcf1ddddc333be1e9a330a4758a18a.jpg saved to cache
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f78d210>
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_ea9d33dfec62b71b0ee911f8664ef52f.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_ea9d33dfec62b71b0ee911f8664ef52f.jpg saved to cache
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_96a4af9c5896015a1f7f9166abd80e7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eeba950>
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_bd86750f4d3cf807cafa735a3f06049c.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_bd86750f4d3cf807cafa735a3f06049c.jpg saved to cache
2026-03-30 12:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee7d610>
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_51ca707716c2e51442d301d8e09b65b4.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_51ca707716c2e51442d301d8e09b65b4.jpg saved to cache
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ed337d0>
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_bafd4107c7e8803e1c9ab31ccc16276e.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_bafd4107c7e8803e1c9ab31ccc16276e.jpg saved to cache
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee90350>
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_3d5805f2f4de1c345cdddc95bf47950f.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_3d5805f2f4de1c345cdddc95bf47950f.jpg saved to cache
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_b77025a9f6db667557098d010723f54a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6eebc1d0>
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_f26e3f6176a74ea344493cc1eab3a456.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_f26e3f6176a74ea344493cc1eab3a456.jpg saved to cache
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7406d010>
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_96a4af9c5896015a1f7f9166abd80e7b.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_96a4af9c5896015a1f7f9166abd80e7b.jpg saved to cache
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a5fd0>
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F47%252F4e474be9bc03cab73d363409611d9238%252Fpa%252FZR70834_b77025a9f6db667557098d010723f54a.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_b77025a9f6db667557098d010723f54a.jpg saved to cache
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f
2026-03-30 12:15:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fcd7925-6feb-5e0f-baea-de68ba43f73f, skipping ID generation
2026-03-30 12:15:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f with scrape type 1
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fcd7925-6feb-5e0f-baea-de68ba43f73f sending to next pipeline
2026-03-30 12:15:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8fcd7925-6feb-5e0f-baea-de68ba43f73f, identifier: ZR70834
2026-03-30 12:15:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8fcd7925-6feb-5e0f-baea-de68ba43f73f with identifier: ZR70834
2026-03-30 12:15:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8fcd7925-6feb-5e0f-baea-de68ba43f73f with identifier: ZR70834
2026-03-30 12:15:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8fcd7925-6feb-5e0f-baea-de68ba43f73f with identifier: ZR70834 to the API
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_b77025a9f6db667557098d010723f54a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:17:57Z',
 'fuel_type': 'petrol',
 'id': '8fcd7925-6feb-5e0f-baea-de68ba43f73f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RL800S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR70834',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 81331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_ea9d33dfec62b71b0ee911f8664ef52f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_d715527536bd5da7adf0ba807dea2b70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_bafd4107c7e8803e1c9ab31ccc16276e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_1bdcf1ddddc333be1e9a330a4758a18a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_bd86750f4d3cf807cafa735a3f06049c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_51ca707716c2e51442d301d8e09b65b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_3d5805f2f4de1c345cdddc95bf47950f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_f26e3f6176a74ea344493cc1eab3a456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_b77025a9f6db667557098d010723f54a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcd7925-6feb-5e0f-baea-de68ba43f73f/8fcd7925-6feb-5e0f-baea-de68ba43f73f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/47/4e474be9bc03cab73d363409611d9238/pa/ZR70834_96a4af9c5896015a1f7f9166abd80e7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2018}
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR70834%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [auto1.nl] INFO: Saving data for ZR70834: {'created_time': 1774872926.707613, 'last_price_update_time': 1774872926.707624, 'auction_closing_time': 1774970277.0}
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR70834') HTTP/1.1" 204 0
2026-03-30 12:15:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.397(s), this was the 1st time calling it.
2026-03-30 12:15:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.259906085966534 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:15:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:15:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.025(s), this was the 1st time calling it.
2026-03-30 12:15:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.8358117397586895 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:15:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG81860> (referer: https://www.auto1.com/v1/car-details-view/ZG81860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53233d8b-8c89-5757-90d7-af781f57faed with identifier: ZG81860
2026-03-30 12:15:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53233d8b-8c89-5757-90d7-af781f57faed with scrape type 1
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53233d8b-8c89-5757-90d7-af781f57faed
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_8e77c741b8d33b58be4529890610e0cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_8e77c741b8d33b58be4529890610e0cc.jpg already downloaded
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_3195d1fc25766e00d23d2c0b61235afd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_3195d1fc25766e00d23d2c0b61235afd.jpg already downloaded
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_91ce53e4201a1052975c62111be66127.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_91ce53e4201a1052975c62111be66127.jpg already downloaded
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_68b8d42310a941ca58b86a34ccb961f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_68b8d42310a941ca58b86a34ccb961f7.jpg already downloaded
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_f4b2f4d2b8ca4adecfa2f588aea7c65b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_f4b2f4d2b8ca4adecfa2f588aea7c65b.jpg already downloaded
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_0f88639142228867e741afa94863eb4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_0f88639142228867e741afa94863eb4a.jpg already downloaded
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_55ccf8801abd16a3c20dc84f6bdc3953.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_55ccf8801abd16a3c20dc84f6bdc3953.jpg already downloaded
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_dea5eda9108b6af5e23c1a0c3a9b8864.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_dea5eda9108b6af5e23c1a0c3a9b8864.jpg already downloaded
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_4431589ef4ff0b276ff00b032de09f1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_4431589ef4ff0b276ff00b032de09f1b.jpg already downloaded
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fab%252Fd8ab48967b5586d89da5f5cee27c787d%252Fpa%252FZG81860_6c97701b44994e1abd720ee5a0aad52f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_6c97701b44994e1abd720ee5a0aad52f.jpg already downloaded
2026-03-30 12:15:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 53233d8b-8c89-5757-90d7-af781f57faed, identifier: ZG81860
2026-03-30 12:15:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 53233d8b-8c89-5757-90d7-af781f57faed with identifier: ZG81860
2026-03-30 12:15:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 53233d8b-8c89-5757-90d7-af781f57faed with identifier: ZG81860
2026-03-30 12:15:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 53233d8b-8c89-5757-90d7-af781f57faed with identifier: ZG81860 to the API
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG81860>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:11:12Z',
 'fuel_type': 'petrol',
 'id': '53233d8b-8c89-5757-90d7-af781f57faed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'J951KR',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG81860',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 150497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_8e77c741b8d33b58be4529890610e0cc.jpg',
                'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_3195d1fc25766e00d23d2c0b61235afd.jpg',
                'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_91ce53e4201a1052975c62111be66127.jpg',
                'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_68b8d42310a941ca58b86a34ccb961f7.jpg',
                'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_f4b2f4d2b8ca4adecfa2f588aea7c65b.jpg',
                'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_0f88639142228867e741afa94863eb4a.jpg',
                'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_55ccf8801abd16a3c20dc84f6bdc3953.jpg',
                'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_dea5eda9108b6af5e23c1a0c3a9b8864.jpg',
                'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_4431589ef4ff0b276ff00b032de09f1b.jpg',
                'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_6c97701b44994e1abd720ee5a0aad52f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_8e77c741b8d33b58be4529890610e0cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_3195d1fc25766e00d23d2c0b61235afd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_91ce53e4201a1052975c62111be66127.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_68b8d42310a941ca58b86a34ccb961f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_f4b2f4d2b8ca4adecfa2f588aea7c65b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436436,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_0f88639142228867e741afa94863eb4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_55ccf8801abd16a3c20dc84f6bdc3953.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_dea5eda9108b6af5e23c1a0c3a9b8864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_4431589ef4ff0b276ff00b032de09f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53233d8b-8c89-5757-90d7-af781f57faed/53233d8b-8c89-5757-90d7-af781f57faed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/ab/d8ab48967b5586d89da5f5cee27c787d/pa/ZG81860_6c97701b44994e1abd720ee5a0aad52f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG81860%27 HTTP/1.1" 200 None
2026-03-30 12:15:47 [auto1.nl] INFO: Saving data for ZG81860: {'created_time': 1774872947.699594, 'last_price_update_time': 1774872947.699604, 'auction_closing_time': 1774969872.0}
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG81860') HTTP/1.1" 204 0
2026-03-30 12:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST56241> (referer: https://www.auto1.com/v1/car-details-view/ST56241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c8a03c-489e-5836-ae57-1fdd1f1831cf with identifier: ST56241
2026-03-30 12:15:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c8a03c-489e-5836-ae57-1fdd1f1831cf with scrape type 1
2026-03-30 12:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 83c8a03c-489e-5836-ae57-1fdd1f1831cf
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_ae65f3e37bde3265544fdbcf2bad38ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_ae65f3e37bde3265544fdbcf2bad38ed.jpg not downloaded yet
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_e1fc995635b9bd80e57fb90ddcf9513c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_e1fc995635b9bd80e57fb90ddcf9513c.jpg not downloaded yet
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_f4512ee64d1b3c22b6984fa5694c62ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_f4512ee64d1b3c22b6984fa5694c62ed.jpg not downloaded yet
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_b0788d3f4e6ef6ef6d37539234907442.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_b0788d3f4e6ef6ef6d37539234907442.jpg not downloaded yet
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_91b6428a5e1d7a402d5b8d0b2708734f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_91b6428a5e1d7a402d5b8d0b2708734f.jpg not downloaded yet
2026-03-30 12:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_e1fc995635b9bd80e57fb90ddcf9513c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_ae65f3e37bde3265544fdbcf2bad38ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_b0788d3f4e6ef6ef6d37539234907442.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_f4512ee64d1b3c22b6984fa5694c62ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_91b6428a5e1d7a402d5b8d0b2708734f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74124710>
2026-03-30 12:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_e1fc995635b9bd80e57fb90ddcf9513c.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_e1fc995635b9bd80e57fb90ddcf9513c.jpg saved to cache
2026-03-30 12:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83c8a03c-489e-5836-ae57-1fdd1f1831cf
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b7406a090>
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_ae65f3e37bde3265544fdbcf2bad38ed.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_ae65f3e37bde3265544fdbcf2bad38ed.jpg saved to cache
2026-03-30 12:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83c8a03c-489e-5836-ae57-1fdd1f1831cf
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b74090150>
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_b0788d3f4e6ef6ef6d37539234907442.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_b0788d3f4e6ef6ef6d37539234907442.jpg saved to cache
2026-03-30 12:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83c8a03c-489e-5836-ae57-1fdd1f1831cf
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6ee88c90>
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_f4512ee64d1b3c22b6984fa5694c62ed.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_f4512ee64d1b3c22b6984fa5694c62ed.jpg saved to cache
2026-03-30 12:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83c8a03c-489e-5836-ae57-1fdd1f1831cf
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9b6f7a7390>
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fad%252Fd7ad785c4fbb8326304cca645008dad3%252Fpa%252FST56241_91b6428a5e1d7a402d5b8d0b2708734f.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_91b6428a5e1d7a402d5b8d0b2708734f.jpg saved to cache
2026-03-30 12:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83c8a03c-489e-5836-ae57-1fdd1f1831cf
2026-03-30 12:15:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83c8a03c-489e-5836-ae57-1fdd1f1831cf, skipping ID generation
2026-03-30 12:15:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c8a03c-489e-5836-ae57-1fdd1f1831cf with scrape type 1
2026-03-30 12:15:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83c8a03c-489e-5836-ae57-1fdd1f1831cf sending to next pipeline
2026-03-30 12:15:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83c8a03c-489e-5836-ae57-1fdd1f1831cf, identifier: ST56241
2026-03-30 12:15:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83c8a03c-489e-5836-ae57-1fdd1f1831cf with identifier: ST56241
2026-03-30 12:15:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83c8a03c-489e-5836-ae57-1fdd1f1831cf with identifier: ST56241
2026-03-30 12:15:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83c8a03c-489e-5836-ae57-1fdd1f1831cf with identifier: ST56241 to the API
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_91b6428a5e1d7a402d5b8d0b2708734f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:19:31Z',
 'fuel_type': 'petrol',
 'id': '83c8a03c-489e-5836-ae57-1fdd1f1831cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '77GNVX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST56241',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 201982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_ae65f3e37bde3265544fdbcf2bad38ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_e1fc995635b9bd80e57fb90ddcf9513c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_f4512ee64d1b3c22b6984fa5694c62ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_b0788d3f4e6ef6ef6d37539234907442.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c8a03c-489e-5836-ae57-1fdd1f1831cf/83c8a03c-489e-5836-ae57-1fdd1f1831cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/ad/d7ad785c4fbb8326304cca645008dad3/pa/ST56241_91b6428a5e1d7a402d5b8d0b2708734f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-01-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 206 1.6 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2001}
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST56241%27 HTTP/1.1" 200 None
2026-03-30 12:15:51 [auto1.nl] INFO: Saving data for ST56241: {'created_time': 1774872951.739053, 'last_price_update_time': 1774872951.739064, 'auction_closing_time': 1774970371.0}
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ST56241') HTTP/1.1" 204 0
2026-03-30 12:16:07 [scrapy.extensions.logstats] INFO: Crawled 129 pages (at 4 pages/min), scraped 121 items (at 3 items/min)
2026-03-30 12:16:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:16:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 134.099(s), this was the 1st time calling it.
2026-03-30 12:16:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.708463037666155 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.516(s), this was the 1st time calling it.
2026-03-30 12:16:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.868209347361972 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:16:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:48 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 1028 | hits on page: 40
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: WH88048
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH88048%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for WH88048: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: SV30103
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV30103%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for SV30103: 1
2026-03-30 12:16:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: KC17574
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: UR49266
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: ZG07781
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG07781%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for ZG07781: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: NC71096
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC71096%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for NC71096: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: FV06268
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV06268%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for FV06268: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: UD25640
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: YL18933
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YL18933%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for YL18933: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: TN50119
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN50119%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for TN50119: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: YV69069
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV69069%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for YV69069: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: MU90689
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU90689%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for MU90689: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: MR60949
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR60949%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for MR60949: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: VF08835
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: FM69133
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM69133%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for FM69133: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: MX79285
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX79285%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for MX79285: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for LT65669: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for YD79188: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for RG26073: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: WA03298
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA03298%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for WA03298: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: LA89986
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA89986%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for LA89986: 0
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: FA90105
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: EL19724
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-30 12:16:48 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.nl] INFO: Scrape type for SE62217: 2
2026-03-30 12:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217
2026-03-30 12:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9915c0d2-005b-5323-8029-ffe268817221 with scrape type 2
2026-03-30 12:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9915c0d2-005b-5323-8029-ffe268817221 with scrape type 2
2026-03-30 12:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9915c0d2-005b-5323-8029-ffe268817221, identifier: SE62217
2026-03-30 12:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217
2026-03-30 12:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217
2026-03-30 12:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217 to the API
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 8,
 'expiration_date': '2026-03-30T15:44:16Z',
 'fuel_type': 'electro',
 'id': '9915c0d2-005b-5323-8029-ffe268817221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE62217',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Ami',
 'odometer': 32207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-06',
 'seller_name': None,
 'title': 'Citroen Ami electric drive 6 kW My Ami Cargo',
 'transmission': 'automatic',
 'trim': 'My  Cargo',
 'year': 2022}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.nl] INFO: Saving data for SE62217: {'auction_closing_time': 1774885456.0, 'created_time': 1773688384.100909, 'last_price_update_time': 1774873009.020245}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE62217') HTTP/1.1" 204 0
2026-03-30 12:16:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:49 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.nl] INFO: Scrape type for YU38024: 2
2026-03-30 12:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024
2026-03-30 12:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with scrape type 2
2026-03-30 12:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with scrape type 2
2026-03-30 12:16:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 568f8074-76fa-5f5a-bd3b-e2456a91dc16, identifier: YU38024
2026-03-30 12:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024
2026-03-30 12:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024
2026-03-30 12:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024 to the API
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:15:02Z',
 'fuel_type': 'petrol',
 'id': '568f8074-76fa-5f5a-bd3b-e2456a91dc16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU38024',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 112334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-06',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2015}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.nl] INFO: Saving data for YU38024: {'auction_closing_time': 1774883702.0, 'created_time': 1773749305.406642, 'last_price_update_time': 1774873009.550427}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YU38024') HTTP/1.1" 204 0
2026-03-30 12:16:49 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-30 12:16:49 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-30 12:16:49 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.nl] INFO: Scrape type for JH98357: 2
2026-03-30 12:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357
2026-03-30 12:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6929fd4-fbb5-5def-b36d-64f97912ad14 with scrape type 2
2026-03-30 12:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6929fd4-fbb5-5def-b36d-64f97912ad14 with scrape type 2
2026-03-30 12:16:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b6929fd4-fbb5-5def-b36d-64f97912ad14, identifier: JH98357
2026-03-30 12:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357
2026-03-30 12:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357
2026-03-30 12:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357 to the API
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:21:53Z',
 'fuel_type': 'petrol',
 'id': 'b6929fd4-fbb5-5def-b36d-64f97912ad14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH98357',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 159756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-24',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.nl] INFO: Saving data for JH98357: {'auction_closing_time': 1774884113.0, 'created_time': 1774526471.468998, 'last_price_update_time': 1774873009.955417}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JH98357') HTTP/1.1" 204 0
2026-03-30 12:16:49 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.nl] INFO: Scrape type for KP52767: 2
2026-03-30 12:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767
2026-03-30 12:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9de1d7e-d424-575c-a115-9a0d1824c3c8 with scrape type 2
2026-03-30 12:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9de1d7e-d424-575c-a115-9a0d1824c3c8 with scrape type 2
2026-03-30 12:16:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d9de1d7e-d424-575c-a115-9a0d1824c3c8, identifier: KP52767
2026-03-30 12:16:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.145(s), this was the 1st time calling it.
2026-03-30 12:16:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.608728209236767 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767
2026-03-30 12:16:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767
2026-03-30 12:16:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767 to the API
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:40:27Z',
 'fuel_type': 'petrol',
 'id': 'd9de1d7e-d424-575c-a115-9a0d1824c3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP52767',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 220004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-29',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [auto1.nl] INFO: Saving data for KP52767: {'auction_closing_time': 1774885227.0, 'created_time': 1774267368.098651, 'last_price_update_time': 1774873010.369405}
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP52767') HTTP/1.1" 204 0
2026-03-30 12:16:50 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-30 12:16:50 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [auto1.nl] INFO: Scrape type for DA42701: 2
2026-03-30 12:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with identifier: DA42701
2026-03-30 12:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with scrape type 2
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with scrape type 2
2026-03-30 12:16:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8, identifier: DA42701
2026-03-30 12:16:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with identifier: DA42701
2026-03-30 12:16:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with identifier: DA42701
2026-03-30 12:16:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with identifier: DA42701 to the API
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:30Z',
 'fuel_type': 'petrol',
 'id': 'cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA42701',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 242774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [auto1.nl] INFO: Saving data for DA42701: {'auction_closing_time': 1774883130.0, 'created_time': 1774119701.500131, 'last_price_update_time': 1774873010.769063}
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA42701') HTTP/1.1" 204 0
2026-03-30 12:16:50 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-30 12:16:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:17:07 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 1 pages/min), scraped 126 items (at 5 items/min)
2026-03-30 12:17:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ03630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ03630> (referer: https://www.auto1.com/v1/car-details-view/EJ03630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aa3ea7c-13bb-577f-9d45-8924ab9c79c3 with identifier: EJ03630
2026-03-30 12:17:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa3ea7c-13bb-577f-9d45-8924ab9c79c3 with scrape type 1
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6aa3ea7c-13bb-577f-9d45-8924ab9c79c3
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_293fffc0c5be8f5eadedf9d54fa09336.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_293fffc0c5be8f5eadedf9d54fa09336.jpg already downloaded
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_0362403fd7dfde23a7d5b4517bccda4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_0362403fd7dfde23a7d5b4517bccda4d.jpg already downloaded
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_cde101ecff847b270b8f40f138432609.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_cde101ecff847b270b8f40f138432609.jpg already downloaded
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_ba22519dc4d8b218f424b91a4f79e616.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_ba22519dc4d8b218f424b91a4f79e616.jpg already downloaded
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_4ee183e1ed7ffcfbfe5c2fd3e6ff435e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_4ee183e1ed7ffcfbfe5c2fd3e6ff435e.jpg already downloaded
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_a5bdb0ec44fe81277a4811d136d3cdc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_a5bdb0ec44fe81277a4811d136d3cdc5.jpg already downloaded
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_3133360e794a6943c840bcc4d9e4360e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_3133360e794a6943c840bcc4d9e4360e.jpg already downloaded
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_3640f07dcbd1b6c65e85fbd99f972be8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_3640f07dcbd1b6c65e85fbd99f972be8.jpg already downloaded
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_1268d1f9ba0e599052e328240be01dd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_1268d1f9ba0e599052e328240be01dd3.jpg already downloaded
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F19%252F94199b9843e2b0c2cb97c041c9c9d2e1%252Fpa%252FEJ03630_7d22241cb556f8927631f874580e28ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_7d22241cb556f8927631f874580e28ae.jpg already downloaded
2026-03-30 12:17:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6aa3ea7c-13bb-577f-9d45-8924ab9c79c3, identifier: EJ03630
2026-03-30 12:17:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6aa3ea7c-13bb-577f-9d45-8924ab9c79c3 with identifier: EJ03630
2026-03-30 12:17:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6aa3ea7c-13bb-577f-9d45-8924ab9c79c3 with identifier: EJ03630
2026-03-30 12:17:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6aa3ea7c-13bb-577f-9d45-8924ab9c79c3 with identifier: EJ03630 to the API
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:17:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ03630>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:37Z',
 'fuel_type': 'diesel',
 'id': '6aa3ea7c-13bb-577f-9d45-8924ab9c79c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JZ557J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ03630',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 245919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_293fffc0c5be8f5eadedf9d54fa09336.jpg',
                'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_0362403fd7dfde23a7d5b4517bccda4d.jpg',
                'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_cde101ecff847b270b8f40f138432609.jpg',
                'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_ba22519dc4d8b218f424b91a4f79e616.jpg',
                'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_4ee183e1ed7ffcfbfe5c2fd3e6ff435e.jpg',
                'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_a5bdb0ec44fe81277a4811d136d3cdc5.jpg',
                'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_3133360e794a6943c840bcc4d9e4360e.jpg',
                'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_3640f07dcbd1b6c65e85fbd99f972be8.jpg',
                'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_1268d1f9ba0e599052e328240be01dd3.jpg',
                'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_7d22241cb556f8927631f874580e28ae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_293fffc0c5be8f5eadedf9d54fa09336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_0362403fd7dfde23a7d5b4517bccda4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_cde101ecff847b270b8f40f138432609.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_ba22519dc4d8b218f424b91a4f79e616.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_4ee183e1ed7ffcfbfe5c2fd3e6ff435e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_a5bdb0ec44fe81277a4811d136d3cdc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_3133360e794a6943c840bcc4d9e4360e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_3640f07dcbd1b6c65e85fbd99f972be8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_1268d1f9ba0e599052e328240be01dd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aa3ea7c-13bb-577f-9d45-8924ab9c79c3/6aa3ea7c-13bb-577f-9d45-8924ab9c79c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2654347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/19/94199b9843e2b0c2cb97c041c9c9d2e1/pa/EJ03630_7d22241cb556f8927631f874580e28ae.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 2.2 DTEC I-DTEC Executive',
 'transmission': 'manual',
 'trim': 'I-DTEC Executive',
 'year': 2012}
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ03630%27 HTTP/1.1" 200 None
2026-03-30 12:17:56 [auto1.nl] INFO: Saving data for EJ03630: {'created_time': 1774873076.854964, 'last_price_update_time': 1774873076.854976, 'auction_closing_time': 1774971997.0}
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EJ03630') HTTP/1.1" 204 0
2026-03-30 12:18:07 [scrapy.extensions.logstats] INFO: Crawled 132 pages (at 2 pages/min), scraped 127 items (at 1 items/min)
2026-03-30 12:18:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:18:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.504(s), this was the 1st time calling it.
2026-03-30 12:18:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.861124925530663 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.598(s), this was the 1st time calling it.
2026-03-30 12:19:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.910724906679645 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.866(s), this was the 2nd time calling it.
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.4160464066435976 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:07 [scrapy.extensions.logstats] INFO: Crawled 132 pages (at 0 pages/min), scraped 127 items (at 0 items/min)
2026-03-30 12:19:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:19:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:09 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 1030 | hits on page: 40
2026-03-30 12:19:09 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-30 12:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-30 12:19:09 [auto1.nl] INFO: Scrape type for DA42701: 0
2026-03-30 12:19:09 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-30 12:19:09 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-30 12:19:09 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-30 12:19:09 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-30 12:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-30 12:19:09 [auto1.nl] INFO: Scrape type for WC63917: 2
2026-03-30 12:19:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40aaf431-a673-5341-a6bf-57276e0979cb with identifier: WC63917
2026-03-30 12:19:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40aaf431-a673-5341-a6bf-57276e0979cb with scrape type 2
2026-03-30 12:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40aaf431-a673-5341-a6bf-57276e0979cb with scrape type 2
2026-03-30 12:19:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40aaf431-a673-5341-a6bf-57276e0979cb, identifier: WC63917
2026-03-30 12:19:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40aaf431-a673-5341-a6bf-57276e0979cb with identifier: WC63917
2026-03-30 12:19:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40aaf431-a673-5341-a6bf-57276e0979cb with identifier: WC63917
2026-03-30 12:19:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40aaf431-a673-5341-a6bf-57276e0979cb with identifier: WC63917 to the API
2026-03-30 12:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:23Z',
 'fuel_type': 'petrol',
 'id': '40aaf431-a673-5341-a6bf-57276e0979cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC63917',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 96641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-14',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-30 12:19:10 [auto1.nl] INFO: Saving data for WC63917: {'auction_closing_time': 1774884383.0, 'created_time': 1773774549.956617, 'last_price_update_time': 1774873150.127033}
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC63917') HTTP/1.1" 204 0
2026-03-30 12:19:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:10 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-30 12:19:10 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-30 12:19:10 [auto1.nl] INFO: Scrape type for DU10654: 2
2026-03-30 12:19:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with identifier: DU10654
2026-03-30 12:19:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with scrape type 2
2026-03-30 12:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with scrape type 2
2026-03-30 12:19:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373, identifier: DU10654
2026-03-30 12:19:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with identifier: DU10654
2026-03-30 12:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with identifier: DU10654
2026-03-30 12:19:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with identifier: DU10654 to the API
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:55Z',
 'fuel_type': 'petrol',
 'id': 'ebaf84c6-a20c-5ff1-a8b7-f2300d63d373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU10654',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 403866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-17',
 'seller_name': None,
 'title': 'Volvo V70 2.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-30 12:19:10 [auto1.nl] INFO: Saving data for DU10654: {'auction_closing_time': 1774886215.0, 'created_time': 1774551737.535687, 'last_price_update_time': 1774873150.671507}
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DU10654') HTTP/1.1" 204 0
2026-03-30 12:19:10 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-30 12:19:10 [auto1.nl] INFO: Scrape type for MP41726: 2
2026-03-30 12:19:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726
2026-03-30 12:19:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222764fa-5fed-544e-8267-317c3b06ebd9 with scrape type 2
2026-03-30 12:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 222764fa-5fed-544e-8267-317c3b06ebd9 with scrape type 2
2026-03-30 12:19:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 222764fa-5fed-544e-8267-317c3b06ebd9, identifier: MP41726
2026-03-30 12:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV30103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726
2026-03-30 12:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726
2026-03-30 12:19:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726 to the API
2026-03-30 12:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:27:20Z',
 'fuel_type': 'petrol',
 'id': '222764fa-5fed-544e-8267-317c3b06ebd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP41726',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 181881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-24',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Elegance',
 'transmission': 'automatic',
 'trim': 'T Elegance',
 'year': 2003}
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-30 12:19:11 [auto1.nl] INFO: Saving data for MP41726: {'auction_closing_time': 1774884440.0, 'created_time': 1774465239.115805, 'last_price_update_time': 1774873151.123636}
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP41726') HTTP/1.1" 204 0
2026-03-30 12:19:11 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-30 12:19:11 [auto1.nl] INFO: Scrape type for HK88309: 2
2026-03-30 12:19:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with identifier: HK88309
2026-03-30 12:19:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with scrape type 2
2026-03-30 12:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with scrape type 2
2026-03-30 12:19:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb, identifier: HK88309
2026-03-30 12:19:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with identifier: HK88309
2026-03-30 12:19:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with identifier: HK88309
2026-03-30 12:19:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with identifier: HK88309 to the API
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:46:53Z',
 'fuel_type': 'petrol',
 'id': '21d0b72e-500c-5d8a-833a-8c8c0632b3cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK88309',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 253868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-30',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-30 12:19:11 [auto1.nl] INFO: Saving data for HK88309: {'auction_closing_time': 1774885613.0, 'created_time': 1774551711.407288, 'last_price_update_time': 1774873151.501513}
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK88309') HTTP/1.1" 204 0
2026-03-30 12:19:11 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-30 12:19:11 [auto1.nl] INFO: Scrape type for FB29349: 2
2026-03-30 12:19:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with identifier: FB29349
2026-03-30 12:19:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with scrape type 2
2026-03-30 12:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with scrape type 2
2026-03-30 12:19:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a, identifier: FB29349
2026-03-30 12:19:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with identifier: FB29349
2026-03-30 12:19:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with identifier: FB29349
2026-03-30 12:19:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with identifier: FB29349 to the API
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:49:40Z',
 'fuel_type': 'petrol',
 'id': 'e20aa573-fa94-533f-bb99-c2d5ee3c2f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB29349',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 309924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-30 12:19:11 [auto1.nl] INFO: Saving data for FB29349: {'auction_closing_time': 1774885780.0, 'created_time': 1773836978.689141, 'last_price_update_time': 1774873151.88274}
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB29349') HTTP/1.1" 204 0
2026-03-30 12:19:11 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-30 12:19:11 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-30 12:19:11 [auto1.nl] INFO: Scrape type for TM57044: 2
2026-03-30 12:19:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with identifier: TM57044
2026-03-30 12:19:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with scrape type 2
2026-03-30 12:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with scrape type 2
2026-03-30 12:19:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc70a00e-a033-5a3b-b162-43e7bd43d0f5, identifier: TM57044
2026-03-30 12:19:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with identifier: TM57044
2026-03-30 12:19:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with identifier: TM57044
2026-03-30 12:19:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with identifier: TM57044 to the API
2026-03-30 12:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:33:19Z',
 'fuel_type': 'petrol',
 'id': 'fc70a00e-a033-5a3b-b162-43e7bd43d0f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM57044',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 282409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-05',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2008}
2026-03-30 12:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-30 12:19:12 [auto1.nl] INFO: Saving data for TM57044: {'auction_closing_time': 1774884799.0, 'created_time': 1774551725.569602, 'last_price_update_time': 1774873152.964725}
2026-03-30 12:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TM57044') HTTP/1.1" 204 0
2026-03-30 12:19:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:12 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-30 12:19:12 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-30 12:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-30 12:19:13 [auto1.nl] INFO: Scrape type for NG83103: 2
2026-03-30 12:19:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103
2026-03-30 12:19:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6d9171-6b59-550e-aeeb-96d27288907e with scrape type 2
2026-03-30 12:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6d9171-6b59-550e-aeeb-96d27288907e with scrape type 2
2026-03-30 12:19:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e6d9171-6b59-550e-aeeb-96d27288907e, identifier: NG83103
2026-03-30 12:19:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103
2026-03-30 12:19:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103
2026-03-30 12:19:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103 to the API
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:49:48Z',
 'fuel_type': 'petrol',
 'id': '2e6d9171-6b59-550e-aeeb-96d27288907e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG83103',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 82399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Style',
 'year': 2018}
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-30 12:19:13 [auto1.nl] INFO: Saving data for NG83103: {'auction_closing_time': 1774885788.0, 'created_time': 1774785638.901458, 'last_price_update_time': 1774873153.431551}
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NG83103') HTTP/1.1" 204 0
2026-03-30 12:19:13 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-30 12:19:13 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-30 12:19:13 [auto1.nl] INFO: Scrape type for MW44280: 2
2026-03-30 12:19:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280
2026-03-30 12:19:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with scrape type 2
2026-03-30 12:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with scrape type 2
2026-03-30 12:19:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf, identifier: MW44280
2026-03-30 12:19:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280
2026-03-30 12:19:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280
2026-03-30 12:19:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280 to the API
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:30:37Z',
 'fuel_type': 'petrol',
 'id': 'ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW44280',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 272314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-05-31',
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 3.3 LE',
 'transmission': 'automatic',
 'trim': 'LE',
 'year': 1997}
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-30 12:19:13 [auto1.nl] INFO: Saving data for MW44280: {'auction_closing_time': 1774884637.0, 'created_time': 1774551699.428745, 'last_price_update_time': 1774873153.887737}
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW44280') HTTP/1.1" 204 0
2026-03-30 12:19:13 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-30 12:19:13 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-30 12:19:13 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-30 12:19:14 [auto1.nl] INFO: Scrape type for BN75332: 2
2026-03-30 12:19:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-30 12:19:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebbc78c-5f24-54dc-a529-fab497851a5f with scrape type 2
2026-03-30 12:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ebbc78c-5f24-54dc-a529-fab497851a5f with scrape type 2
2026-03-30 12:19:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ebbc78c-5f24-54dc-a529-fab497851a5f, identifier: BN75332
2026-03-30 12:19:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-30 12:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-30 12:19:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332 to the API
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:33:41Z',
 'fuel_type': 'petrol',
 'id': '4ebbc78c-5f24-54dc-a529-fab497851a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN75332',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 279342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-08',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-30 12:19:14 [auto1.nl] INFO: Saving data for BN75332: {'auction_closing_time': 1774884821.0, 'created_time': 1774638151.099448, 'last_price_update_time': 1774873154.383071}
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN75332') HTTP/1.1" 204 0
2026-03-30 12:19:14 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW37625%27 HTTP/1.1" 200 None
2026-03-30 12:19:14 [auto1.nl] INFO: Scrape type for DW37625: 2
2026-03-30 12:19:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 759e4dce-919f-5300-b357-3718e28dbd6b with identifier: DW37625
2026-03-30 12:19:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 759e4dce-919f-5300-b357-3718e28dbd6b with scrape type 2
2026-03-30 12:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 759e4dce-919f-5300-b357-3718e28dbd6b with scrape type 2
2026-03-30 12:19:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 759e4dce-919f-5300-b357-3718e28dbd6b, identifier: DW37625
2026-03-30 12:19:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 759e4dce-919f-5300-b357-3718e28dbd6b with identifier: DW37625
2026-03-30 12:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 759e4dce-919f-5300-b357-3718e28dbd6b with identifier: DW37625
2026-03-30 12:19:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 759e4dce-919f-5300-b357-3718e28dbd6b with identifier: DW37625 to the API
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:07:03Z',
 'fuel_type': 'petrol',
 'id': '759e4dce-919f-5300-b357-3718e28dbd6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW37625',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 131053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW37625%27 HTTP/1.1" 200 None
2026-03-30 12:19:14 [auto1.nl] INFO: Saving data for DW37625: {'auction_closing_time': 1774883223.0, 'created_time': 1774785638.5506, 'last_price_update_time': 1774873154.807339}
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DW37625') HTTP/1.1" 204 0
2026-03-30 12:19:14 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-30 12:19:14 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-30 12:19:14 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-30 12:19:14 [auto1.nl] INFO: Scrape type for CE26691: 2
2026-03-30 12:19:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691
2026-03-30 12:19:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with scrape type 2
2026-03-30 12:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with scrape type 2
2026-03-30 12:19:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615, identifier: CE26691
2026-03-30 12:19:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691
2026-03-30 12:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691
2026-03-30 12:19:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691 to the API
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:51:58Z',
 'fuel_type': 'petrol',
 'id': '0e2f8970-2c26-5b6d-88cd-de93fd8ac615',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE26691',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 199596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-30 12:19:15 [auto1.nl] INFO: Saving data for CE26691: {'auction_closing_time': 1774885918.0, 'created_time': 1774551701.798766, 'last_price_update_time': 1774873155.275229}
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CE26691') HTTP/1.1" 204 0
2026-03-30 12:19:15 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-30 12:19:15 [auto1.nl] INFO: Scrape type for GR22460: 2
2026-03-30 12:19:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-30 12:19:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with scrape type 2
2026-03-30 12:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with scrape type 2
2026-03-30 12:19:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f, identifier: GR22460
2026-03-30 12:19:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-30 12:19:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-30 12:19:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460 to the API
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'petrol',
 'id': 'fe0374b9-a0e1-5263-a0c2-c8448f3fb80f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR22460',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 226203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-28',
 'seller_name': None,
 'title': 'Ford C-Max 2.0 Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-30 12:19:15 [auto1.nl] INFO: Saving data for GR22460: {'auction_closing_time': 1774885762.0, 'created_time': 1774638122.518145, 'last_price_update_time': 1774873155.68028}
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GR22460') HTTP/1.1" 204 0
2026-03-30 12:19:15 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-30 12:19:15 [auto1.nl] INFO: Scrape type for WM06162: 2
2026-03-30 12:19:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162
2026-03-30 12:19:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with scrape type 2
2026-03-30 12:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with scrape type 2
2026-03-30 12:19:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f0fb6e6a-a9b3-50db-96ce-c96007f38a85, identifier: WM06162
2026-03-30 12:19:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162
2026-03-30 12:19:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162
2026-03-30 12:19:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162 to the API
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:47:13Z',
 'fuel_type': 'petrol',
 'id': 'f0fb6e6a-a9b3-50db-96ce-c96007f38a85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM06162',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 138869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-21',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium S',
 'transmission': 'automatic',
 'trim': 'Titanium S',
 'year': 2014}
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [auto1.nl] INFO: Saving data for WM06162: {'auction_closing_time': 1774885633.0, 'created_time': 1773775047.480405, 'last_price_update_time': 1774873156.084701}
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WM06162') HTTP/1.1" 204 0
2026-03-30 12:19:16 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [auto1.nl] INFO: Scrape type for CP88423: 2
2026-03-30 12:19:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-30 12:19:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with scrape type 2
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with scrape type 2
2026-03-30 12:19:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f, identifier: CP88423
2026-03-30 12:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-30 12:19:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-30 12:19:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423 to the API
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:40Z',
 'fuel_type': 'petrol',
 'id': 'dfec76ea-b5ec-5e5a-b119-d4d79c8f197f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP88423',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 227968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-28',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 SW',
 'transmission': 'manual',
 'trim': 'SW',
 'year': 2007}
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [auto1.nl] INFO: Saving data for CP88423: {'auction_closing_time': 1774885000.0, 'created_time': 1774378898.86484, 'last_price_update_time': 1774873156.515266}
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP88423') HTTP/1.1" 204 0
2026-03-30 12:19:16 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [auto1.nl] INFO: Scrape type for SG18673: 2
2026-03-30 12:19:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-30 12:19:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f559aa47-9bb2-560f-ae90-8b062944e1ee with scrape type 2
2026-03-30 12:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f559aa47-9bb2-560f-ae90-8b062944e1ee with scrape type 2
2026-03-30 12:19:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f559aa47-9bb2-560f-ae90-8b062944e1ee, identifier: SG18673
2026-03-30 12:19:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-30 12:19:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-30 12:19:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673 to the API
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:28:56Z',
 'fuel_type': 'petrol',
 'id': 'f559aa47-9bb2-560f-ae90-8b062944e1ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG18673',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 139178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-08',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2003}
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-30 12:19:16 [auto1.nl] INFO: Saving data for SG18673: {'auction_closing_time': 1774884536.0, 'created_time': 1773774549.425644, 'last_price_update_time': 1774873156.95008}
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SG18673') HTTP/1.1" 204 0
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: LX02211
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-30 12:19:17 [auto1.nl] INFO: Scrape type for FW01389: 2
2026-03-30 12:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389
2026-03-30 12:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e74020a-70a1-5c66-a76c-68c7d8f337dd with scrape type 2
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e74020a-70a1-5c66-a76c-68c7d8f337dd with scrape type 2
2026-03-30 12:19:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7e74020a-70a1-5c66-a76c-68c7d8f337dd, identifier: FW01389
2026-03-30 12:19:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389
2026-03-30 12:19:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389
2026-03-30 12:19:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389 to the API
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:09:56Z',
 'fuel_type': 'petrol',
 'id': '7e74020a-70a1-5c66-a76c-68c7d8f337dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW01389',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 174142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-23',
 'seller_name': None,
 'title': 'Renault Modus 1.4 Exception',
 'transmission': 'manual',
 'trim': 'Exception',
 'year': 2007}
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-30 12:19:17 [auto1.nl] INFO: Saving data for FW01389: {'auction_closing_time': 1774883396.0, 'created_time': 1773489728.857906, 'last_price_update_time': 1774873157.477492}
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FW01389') HTTP/1.1" 204 0
2026-03-30 12:19:17 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 1030 | hits on page: 40
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: UE59902
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE59902%27 HTTP/1.1" 200 None
2026-03-30 12:19:17 [auto1.nl] INFO: Scrape type for UE59902: 2
2026-03-30 12:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21874000-53aa-550f-9881-22a95e15ec50 with identifier: UE59902
2026-03-30 12:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21874000-53aa-550f-9881-22a95e15ec50 with scrape type 2
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21874000-53aa-550f-9881-22a95e15ec50 with scrape type 2
2026-03-30 12:19:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 21874000-53aa-550f-9881-22a95e15ec50, identifier: UE59902
2026-03-30 12:19:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 21874000-53aa-550f-9881-22a95e15ec50 with identifier: UE59902
2026-03-30 12:19:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 21874000-53aa-550f-9881-22a95e15ec50 with identifier: UE59902
2026-03-30 12:19:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 21874000-53aa-550f-9881-22a95e15ec50 with identifier: UE59902 to the API
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-30T15:14:05Z',
 'fuel_type': 'hybrid',
 'id': '21874000-53aa-550f-9881-22a95e15ec50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE59902',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 187384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-03',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE59902%27 HTTP/1.1" 200 None
2026-03-30 12:19:17 [auto1.nl] INFO: Saving data for UE59902: {'auction_closing_time': 1774883645.0, 'created_time': 1773232015.053081, 'last_price_update_time': 1774873157.878164}
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE59902') HTTP/1.1" 204 0
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: RK38734
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-30 12:19:17 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH12020%27 HTTP/1.1" 200 None
2026-03-30 12:19:17 [auto1.nl] INFO: Scrape type for LH12020: 2
2026-03-30 12:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0917ace8-5df1-5590-94ca-594a389ead8c with identifier: LH12020
2026-03-30 12:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0917ace8-5df1-5590-94ca-594a389ead8c with scrape type 2
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0917ace8-5df1-5590-94ca-594a389ead8c with scrape type 2
2026-03-30 12:19:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0917ace8-5df1-5590-94ca-594a389ead8c, identifier: LH12020
2026-03-30 12:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:18 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-30 12:19:18 [auto1.nl] INFO: Found listing with ID: DW76665
2026-03-30 12:19:18 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-30 12:19:18 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [auto1.nl] INFO: Scrape type for DS12539: 2
2026-03-30 12:19:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539
2026-03-30 12:19:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d999b2-4cbe-5518-89c1-1a68def3a899 with scrape type 2
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7d999b2-4cbe-5518-89c1-1a68def3a899 with scrape type 2
2026-03-30 12:19:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7d999b2-4cbe-5518-89c1-1a68def3a899, identifier: DS12539
2026-03-30 12:19:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0917ace8-5df1-5590-94ca-594a389ead8c with identifier: LH12020
2026-03-30 12:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0917ace8-5df1-5590-94ca-594a389ead8c with identifier: LH12020
2026-03-30 12:19:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0917ace8-5df1-5590-94ca-594a389ead8c with identifier: LH12020 to the API
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:21:11Z',
 'fuel_type': 'petrol',
 'id': '0917ace8-5df1-5590-94ca-594a389ead8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH12020',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 241962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-08-20',
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Linea Luna',
 'transmission': 'manual',
 'trim': 'Linea Luna',
 'year': 2000}
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH12020%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [auto1.nl] INFO: Saving data for LH12020: {'auction_closing_time': 1774884071.0, 'created_time': 1773232263.935977, 'last_price_update_time': 1774873158.421578}
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH12020') HTTP/1.1" 204 0
2026-03-30 12:19:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539
2026-03-30 12:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539
2026-03-30 12:19:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539 to the API
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:13:25Z',
 'fuel_type': 'petrol',
 'id': 'a7d999b2-4cbe-5518-89c1-1a68def3a899',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS12539',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 214910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-06',
 'seller_name': None,
 'title': 'Ford C-Max 2.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [auto1.nl] INFO: Saving data for DS12539: {'auction_closing_time': 1774883605.0, 'created_time': 1774638102.382682, 'last_price_update_time': 1774873158.807273}
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DS12539') HTTP/1.1" 204 0
2026-03-30 12:19:18 [auto1.nl] INFO: Found listing with ID: NA59748
2026-03-30 12:19:18 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-30 12:19:18 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-30 12:19:18 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [auto1.nl] INFO: Scrape type for JF28004: 2
2026-03-30 12:19:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004
2026-03-30 12:19:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27df40ce-744c-5651-8ea7-c7b91875c664 with scrape type 2
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27df40ce-744c-5651-8ea7-c7b91875c664 with scrape type 2
2026-03-30 12:19:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 27df40ce-744c-5651-8ea7-c7b91875c664, identifier: JF28004
2026-03-30 12:19:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004
2026-03-30 12:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004
2026-03-30 12:19:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004 to the API
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:53:36Z',
 'fuel_type': 'petrol',
 'id': '27df40ce-744c-5651-8ea7-c7b91875c664',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF28004',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 206099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-08',
 'seller_name': None,
 'title': 'Smart fortwo 0.7 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2005}
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [auto1.nl] INFO: Saving data for JF28004: {'auction_closing_time': 1774886016.0, 'created_time': 1773947350.579692, 'last_price_update_time': 1774873159.329665}
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JF28004') HTTP/1.1" 204 0
2026-03-30 12:19:19 [auto1.nl] INFO: Found listing with ID: MG34346
2026-03-30 12:19:19 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE22789%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [auto1.nl] INFO: Scrape type for ZE22789: 2
2026-03-30 12:19:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789
2026-03-30 12:19:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681857c0-ef25-5c50-82a3-b1ecb348898e with scrape type 2
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681857c0-ef25-5c50-82a3-b1ecb348898e with scrape type 2
2026-03-30 12:19:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 681857c0-ef25-5c50-82a3-b1ecb348898e, identifier: ZE22789
2026-03-30 12:19:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789
2026-03-30 12:19:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789
2026-03-30 12:19:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789 to the API
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:19:02Z',
 'fuel_type': 'hybrid',
 'id': '681857c0-ef25-5c50-82a3-b1ecb348898e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE22789',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 76421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-25',
 'seller_name': None,
 'title': 'BMW 5er 530e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE22789%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [auto1.nl] INFO: Saving data for ZE22789: {'auction_closing_time': 1774883942.0, 'created_time': 1774785647.858606, 'last_price_update_time': 1774873159.75773}
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE22789') HTTP/1.1" 204 0
2026-03-30 12:19:19 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-30 12:19:19 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-30 12:19:19 [auto1.nl] INFO: Scrape type for LW17731: 2
2026-03-30 12:19:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731
2026-03-30 12:19:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d195d9c7-1662-5d32-845c-dddf89cb6c27 with scrape type 2
2026-03-30 12:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d195d9c7-1662-5d32-845c-dddf89cb6c27 with scrape type 2
2026-03-30 12:19:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d195d9c7-1662-5d32-845c-dddf89cb6c27, identifier: LW17731
2026-03-30 12:19:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731
2026-03-30 12:19:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731
2026-03-30 12:19:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731 to the API
2026-03-30 12:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:40:48Z',
 'fuel_type': 'petrol',
 'id': 'd195d9c7-1662-5d32-845c-dddf89cb6c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW17731',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 163770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-12-18',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2003}
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-30 12:19:20 [auto1.nl] INFO: Saving data for LW17731: {'auction_closing_time': 1774885248.0, 'created_time': 1773514907.65098, 'last_price_update_time': 1774873160.200512}
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LW17731') HTTP/1.1" 204 0
2026-03-30 12:19:20 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE49757%27 HTTP/1.1" 200 None
2026-03-30 12:19:20 [auto1.nl] INFO: Scrape type for YE49757: 2
2026-03-30 12:19:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4399cde5-2731-53c5-b40d-3895a2de43db with identifier: YE49757
2026-03-30 12:19:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4399cde5-2731-53c5-b40d-3895a2de43db with scrape type 2
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4399cde5-2731-53c5-b40d-3895a2de43db with scrape type 2
2026-03-30 12:19:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4399cde5-2731-53c5-b40d-3895a2de43db, identifier: YE49757
2026-03-30 12:19:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4399cde5-2731-53c5-b40d-3895a2de43db with identifier: YE49757
2026-03-30 12:19:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4399cde5-2731-53c5-b40d-3895a2de43db with identifier: YE49757
2026-03-30 12:19:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4399cde5-2731-53c5-b40d-3895a2de43db with identifier: YE49757 to the API
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:18:35Z',
 'fuel_type': 'petrol',
 'id': '4399cde5-2731-53c5-b40d-3895a2de43db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE49757',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 148840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-09',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Petit Filou',
 'transmission': 'manual',
 'trim': 'Petit Filou',
 'year': 2006}
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE49757%27 HTTP/1.1" 200 None
2026-03-30 12:19:20 [auto1.nl] INFO: Saving data for YE49757: {'auction_closing_time': 1774883915.0, 'created_time': 1774551699.138066, 'last_price_update_time': 1774873160.69883}
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YE49757') HTTP/1.1" 204 0
2026-03-30 12:19:20 [auto1.nl] INFO: Found listing with ID: XU83484
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU83484%27 HTTP/1.1" 200 None
2026-03-30 12:19:20 [auto1.nl] INFO: Scrape type for XU83484: 2
2026-03-30 12:19:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with identifier: XU83484
2026-03-30 12:19:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with scrape type 2
2026-03-30 12:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with scrape type 2
2026-03-30 12:19:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b, identifier: XU83484
2026-03-30 12:19:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with identifier: XU83484
2026-03-30 12:19:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with identifier: XU83484
2026-03-30 12:19:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with identifier: XU83484 to the API
2026-03-30 12:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:32:42Z',
 'fuel_type': 'petrol',
 'id': '2dfa3de0-a40c-5cc4-9fcc-81670f3c433b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU83484',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 166207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-02',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU83484%27 HTTP/1.1" 200 None
2026-03-30 12:19:21 [auto1.nl] INFO: Saving data for XU83484: {'auction_closing_time': 1774884762.0, 'created_time': 1774785651.057075, 'last_price_update_time': 1774873161.126044}
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XU83484') HTTP/1.1" 204 0
2026-03-30 12:19:21 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-30 12:19:21 [auto1.nl] INFO: Scrape type for AJ89396: 2
2026-03-30 12:19:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396
2026-03-30 12:19:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69bb4fe5-7790-5c11-b0ba-6682de008784 with scrape type 2
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69bb4fe5-7790-5c11-b0ba-6682de008784 with scrape type 2
2026-03-30 12:19:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69bb4fe5-7790-5c11-b0ba-6682de008784, identifier: AJ89396
2026-03-30 12:19:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396
2026-03-30 12:19:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396
2026-03-30 12:19:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396 to the API
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:55Z',
 'fuel_type': 'petrol',
 'id': '69bb4fe5-7790-5c11-b0ba-6682de008784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ89396',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 177834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-06',
 'seller_name': None,
 'title': 'Kia Carens 2.0 EX Van',
 'transmission': 'manual',
 'trim': 'EX Van',
 'year': 2005}
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-30 12:19:21 [auto1.nl] INFO: Saving data for AJ89396: {'auction_closing_time': 1774884115.0, 'created_time': 1773749265.064177, 'last_price_update_time': 1774873161.5218}
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AJ89396') HTTP/1.1" 204 0
2026-03-30 12:19:21 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-30 12:19:21 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-30 12:19:21 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-30 12:19:21 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-30 12:19:21 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-30 12:19:21 [auto1.nl] INFO: Scrape type for MW67597: 2
2026-03-30 12:19:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597
2026-03-30 12:19:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b21a97e-a144-5cdd-a610-f712529497ca with scrape type 2
2026-03-30 12:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b21a97e-a144-5cdd-a610-f712529497ca with scrape type 2
2026-03-30 12:19:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b21a97e-a144-5cdd-a610-f712529497ca, identifier: MW67597
2026-03-30 12:19:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597
2026-03-30 12:19:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597
2026-03-30 12:19:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597 to the API
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:28:19Z',
 'fuel_type': 'petrol',
 'id': '5b21a97e-a144-5cdd-a610-f712529497ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW67597',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa GT',
 'odometer': 200763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-25',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa GT 2.0 JTS Selesp Distinctive',
 'transmission': 'automatic',
 'trim': 'Selesp Distinctive',
 'year': 2005}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.nl] INFO: Saving data for MW67597: {'auction_closing_time': 1774884499.0, 'created_time': 1773947286.404418, 'last_price_update_time': 1774873162.02178}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW67597') HTTP/1.1" 204 0
2026-03-30 12:19:22 [auto1.nl] INFO: Found listing with ID: GC17693
2026-03-30 12:19:22 [auto1.nl] INFO: Found listing with ID: ME46694
2026-03-30 12:19:22 [auto1.nl] INFO: Found listing with ID: YD44164
2026-03-30 12:19:22 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS28591%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.nl] INFO: Scrape type for SS28591: 2
2026-03-30 12:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e30b3009-d01f-55db-b151-5ede6a1956db with identifier: SS28591
2026-03-30 12:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e30b3009-d01f-55db-b151-5ede6a1956db with scrape type 2
2026-03-30 12:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e30b3009-d01f-55db-b151-5ede6a1956db with scrape type 2
2026-03-30 12:19:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e30b3009-d01f-55db-b151-5ede6a1956db, identifier: SS28591
2026-03-30 12:19:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e30b3009-d01f-55db-b151-5ede6a1956db with identifier: SS28591
2026-03-30 12:19:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e30b3009-d01f-55db-b151-5ede6a1956db with identifier: SS28591
2026-03-30 12:19:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e30b3009-d01f-55db-b151-5ede6a1956db with identifier: SS28591 to the API
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:24:35Z',
 'fuel_type': 'petrol',
 'id': 'e30b3009-d01f-55db-b151-5ede6a1956db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS28591',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 87076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-24',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS28591%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.nl] INFO: Saving data for SS28591: {'auction_closing_time': 1774884275.0, 'created_time': 1773229283.59128, 'last_price_update_time': 1774873162.43779}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SS28591') HTTP/1.1" 204 0
2026-03-30 12:19:22 [auto1.nl] INFO: Found listing with ID: DJ12615
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ12615%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.nl] INFO: Scrape type for DJ12615: 2
2026-03-30 12:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed63732-fa94-5bde-987e-9cf82c512b0a with identifier: DJ12615
2026-03-30 12:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed63732-fa94-5bde-987e-9cf82c512b0a with scrape type 2
2026-03-30 12:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ed63732-fa94-5bde-987e-9cf82c512b0a with scrape type 2
2026-03-30 12:19:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8ed63732-fa94-5bde-987e-9cf82c512b0a, identifier: DJ12615
2026-03-30 12:19:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8ed63732-fa94-5bde-987e-9cf82c512b0a with identifier: DJ12615
2026-03-30 12:19:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8ed63732-fa94-5bde-987e-9cf82c512b0a with identifier: DJ12615
2026-03-30 12:19:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8ed63732-fa94-5bde-987e-9cf82c512b0a with identifier: DJ12615 to the API
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:16:32Z',
 'fuel_type': 'petrol',
 'id': '8ed63732-fa94-5bde-987e-9cf82c512b0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ12615',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 135085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-29',
 'seller_name': None,
 'title': 'Opel Agila 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2004}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ12615%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.nl] INFO: Saving data for DJ12615: {'auction_closing_time': 1774883792.0, 'created_time': 1774785650.649993, 'last_price_update_time': 1774873162.856841}
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DJ12615') HTTP/1.1" 204 0
2026-03-30 12:19:22 [auto1.nl] INFO: Found listing with ID: EX76007
2026-03-30 12:19:22 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS78045%27 HTTP/1.1" 200 None
2026-03-30 12:19:22 [auto1.nl] INFO: Scrape type for FS78045: 2
2026-03-30 12:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c1ebcc3-879e-524d-9223-a5c8cab7698a with identifier: FS78045
2026-03-30 12:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1ebcc3-879e-524d-9223-a5c8cab7698a with scrape type 2
2026-03-30 12:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c1ebcc3-879e-524d-9223-a5c8cab7698a with scrape type 2
2026-03-30 12:19:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5c1ebcc3-879e-524d-9223-a5c8cab7698a, identifier: FS78045
2026-03-30 12:19:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5c1ebcc3-879e-524d-9223-a5c8cab7698a with identifier: FS78045
2026-03-30 12:19:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5c1ebcc3-879e-524d-9223-a5c8cab7698a with identifier: FS78045
2026-03-30 12:19:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5c1ebcc3-879e-524d-9223-a5c8cab7698a with identifier: FS78045 to the API
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:37:43Z',
 'fuel_type': 'petrol',
 'id': '5c1ebcc3-879e-524d-9223-a5c8cab7698a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS78045',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 170640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-24',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2005}
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS78045%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.nl] INFO: Saving data for FS78045: {'auction_closing_time': 1774885063.0, 'created_time': 1774551743.715782, 'last_price_update_time': 1774873163.312002}
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FS78045') HTTP/1.1" 204 0
2026-03-30 12:19:23 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF33290%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.nl] INFO: Scrape type for FF33290: 2
2026-03-30 12:19:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with identifier: FF33290
2026-03-30 12:19:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with scrape type 2
2026-03-30 12:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with scrape type 2
2026-03-30 12:19:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8, identifier: FF33290
2026-03-30 12:19:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with identifier: FF33290
2026-03-30 12:19:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with identifier: FF33290
2026-03-30 12:19:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with identifier: FF33290 to the API
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:29Z',
 'fuel_type': 'diesel',
 'id': '2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF33290',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-20',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF33290%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.nl] INFO: Saving data for FF33290: {'auction_closing_time': 1774883189.0, 'created_time': 1774785652.537312, 'last_price_update_time': 1774873163.865055}
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FF33290') HTTP/1.1" 204 0
2026-03-30 12:19:23 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB43165%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.nl] INFO: Scrape type for MB43165: 2
2026-03-30 12:19:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165
2026-03-30 12:19:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with scrape type 2
2026-03-30 12:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with scrape type 2
2026-03-30 12:19:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b, identifier: MB43165
2026-03-30 12:19:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165
2026-03-30 12:19:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165
2026-03-30 12:19:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165 to the API
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:15Z',
 'fuel_type': 'petrol',
 'id': '2b9d4aa4-afb0-5498-bbf7-0efe1853157b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB43165',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 57566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB43165%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.nl] INFO: Saving data for MB43165: {'auction_closing_time': 1774884375.0, 'created_time': 1774785654.542801, 'last_price_update_time': 1774873164.276966}
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB43165') HTTP/1.1" 204 0
2026-03-30 12:19:24 [auto1.nl] INFO: Found listing with ID: DK68166
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK68166%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.nl] INFO: Scrape type for DK68166: 2
2026-03-30 12:19:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 748e1a04-c277-5e88-916c-ee3ada95371b with identifier: DK68166
2026-03-30 12:19:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 748e1a04-c277-5e88-916c-ee3ada95371b with scrape type 2
2026-03-30 12:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 748e1a04-c277-5e88-916c-ee3ada95371b with scrape type 2
2026-03-30 12:19:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 748e1a04-c277-5e88-916c-ee3ada95371b, identifier: DK68166
2026-03-30 12:19:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 748e1a04-c277-5e88-916c-ee3ada95371b with identifier: DK68166
2026-03-30 12:19:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 748e1a04-c277-5e88-916c-ee3ada95371b with identifier: DK68166
2026-03-30 12:19:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 748e1a04-c277-5e88-916c-ee3ada95371b with identifier: DK68166 to the API
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 580,
 'expiration_date': '2026-03-30T15:54:25Z',
 'fuel_type': 'petrol',
 'id': '748e1a04-c277-5e88-916c-ee3ada95371b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK68166',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 6',
 'odometer': 154964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-31',
 'seller_name': None,
 'title': 'Audi RS 6 5.0 V10 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK68166%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.nl] INFO: Saving data for DK68166: {'auction_closing_time': 1774886065.0, 'created_time': 1773343674.566893, 'last_price_update_time': 1774873164.712892}
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK68166') HTTP/1.1" 204 0
2026-03-30 12:19:24 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM74497%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.nl] INFO: Scrape type for WM74497: 2
2026-03-30 12:19:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with identifier: WM74497
2026-03-30 12:19:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with scrape type 2
2026-03-30 12:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with scrape type 2
2026-03-30 12:19:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0, identifier: WM74497
2026-03-30 12:19:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with identifier: WM74497
2026-03-30 12:19:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with identifier: WM74497
2026-03-30 12:19:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with identifier: WM74497 to the API
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:47:50Z',
 'fuel_type': 'petrol',
 'id': '359ff304-cdd4-57cd-a4cb-38c0cbf8dae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM74497',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 159061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-16',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM74497%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [auto1.nl] INFO: Saving data for WM74497: {'auction_closing_time': 1774885670.0, 'created_time': 1773861222.657318, 'last_price_update_time': 1774873165.13439}
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WM74497') HTTP/1.1" 204 0
2026-03-30 12:19:25 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-30 12:19:25 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-30 12:19:25 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS47079%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [auto1.nl] INFO: Scrape type for PS47079: 2
2026-03-30 12:19:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ab25f80-8742-5d7e-918f-5200d27da916 with identifier: PS47079
2026-03-30 12:19:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ab25f80-8742-5d7e-918f-5200d27da916 with scrape type 2
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ab25f80-8742-5d7e-918f-5200d27da916 with scrape type 2
2026-03-30 12:19:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2ab25f80-8742-5d7e-918f-5200d27da916, identifier: PS47079
2026-03-30 12:19:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2ab25f80-8742-5d7e-918f-5200d27da916 with identifier: PS47079
2026-03-30 12:19:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2ab25f80-8742-5d7e-918f-5200d27da916 with identifier: PS47079
2026-03-30 12:19:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2ab25f80-8742-5d7e-918f-5200d27da916 with identifier: PS47079 to the API
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:11:03Z',
 'fuel_type': 'petrol',
 'id': '2ab25f80-8742-5d7e-918f-5200d27da916',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS47079',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 60905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-15',
 'seller_name': None,
 'title': 'Audi Q3 40 TFSI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2019}
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS47079%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [auto1.nl] INFO: Saving data for PS47079: {'auction_closing_time': 1774883463.0, 'created_time': 1773132167.488665, 'last_price_update_time': 1774873165.540758}
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PS47079') HTTP/1.1" 204 0
2026-03-30 12:19:25 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV31817%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [auto1.nl] INFO: Scrape type for EV31817: 2
2026-03-30 12:19:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44ca85c7-2f30-580e-8d80-660f41395d99 with identifier: EV31817
2026-03-30 12:19:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ca85c7-2f30-580e-8d80-660f41395d99 with scrape type 2
2026-03-30 12:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44ca85c7-2f30-580e-8d80-660f41395d99 with scrape type 2
2026-03-30 12:19:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 44ca85c7-2f30-580e-8d80-660f41395d99, identifier: EV31817
2026-03-30 12:19:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 44ca85c7-2f30-580e-8d80-660f41395d99 with identifier: EV31817
2026-03-30 12:19:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 44ca85c7-2f30-580e-8d80-660f41395d99 with identifier: EV31817
2026-03-30 12:19:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 44ca85c7-2f30-580e-8d80-660f41395d99 with identifier: EV31817 to the API
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-30T15:13:37Z',
 'fuel_type': 'petrol',
 'id': '44ca85c7-2f30-580e-8d80-660f41395d99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV31817',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 38854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-28',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.3 DIG-T N-Tec',
 'transmission': 'automatic',
 'trim': 'N-Tec',
 'year': 2020}
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV31817%27 HTTP/1.1" 200 None
2026-03-30 12:19:25 [auto1.nl] INFO: Saving data for EV31817: {'auction_closing_time': 1774883617.0, 'created_time': 1774551698.818204, 'last_price_update_time': 1774873165.963462}
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EV31817') HTTP/1.1" 204 0
2026-03-30 12:19:25 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-30 12:19:25 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-30 12:19:25 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-30 12:19:25 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-30 12:19:25 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-30 12:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH55431%27 HTTP/1.1" 200 None
2026-03-30 12:19:26 [auto1.nl] INFO: Scrape type for KH55431: 2
2026-03-30 12:19:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with identifier: KH55431
2026-03-30 12:19:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with scrape type 2
2026-03-30 12:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with scrape type 2
2026-03-30 12:19:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501, identifier: KH55431
2026-03-30 12:19:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with identifier: KH55431
2026-03-30 12:19:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with identifier: KH55431
2026-03-30 12:19:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with identifier: KH55431 to the API
2026-03-30 12:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:39Z',
 'fuel_type': 'petrol',
 'id': '2b2d9d2b-049b-50cf-945e-4e5b9cc17501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH55431',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 233013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-07',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 Ambiance',
 'transmission': 'automatic',
 'trim': 'Ambiance',
 'year': 2009}
2026-03-30 12:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH55431%27 HTTP/1.1" 200 None
2026-03-30 12:19:26 [auto1.nl] INFO: Saving data for KH55431: {'auction_closing_time': 1774883919.0, 'created_time': 1774785653.315084, 'last_price_update_time': 1774873166.345788}
2026-03-30 12:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KH55431') HTTP/1.1" 204 0
2026-03-30 12:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:56 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 1030 | hits on page: 40
2026-03-30 12:19:56 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-30 12:19:56 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [auto1.nl] INFO: Scrape type for UE74675: 2
2026-03-30 12:19:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675
2026-03-30 12:19:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68b6c843-8a8a-563b-874e-9f9237552b00 with scrape type 2
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68b6c843-8a8a-563b-874e-9f9237552b00 with scrape type 2
2026-03-30 12:19:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 68b6c843-8a8a-563b-874e-9f9237552b00, identifier: UE74675
2026-03-30 12:19:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675
2026-03-30 12:19:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675
2026-03-30 12:19:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675 to the API
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:00:28Z',
 'fuel_type': 'petrol',
 'id': '68b6c843-8a8a-563b-874e-9f9237552b00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE74675',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 120637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 TCe Energy Bose Edition',
 'transmission': 'manual',
 'trim': 'Bose Edition',
 'year': 2018}
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [auto1.nl] INFO: Saving data for UE74675: {'auction_closing_time': 1774882828.0, 'created_time': 1773837103.385773, 'last_price_update_time': 1774873196.801883}
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE74675') HTTP/1.1" 204 0
2026-03-30 12:19:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:56 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG10969%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [auto1.nl] INFO: Scrape type for EG10969: 2
2026-03-30 12:19:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d407ea1-43b5-510e-8d5f-6a931dbda60e with identifier: EG10969
2026-03-30 12:19:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d407ea1-43b5-510e-8d5f-6a931dbda60e with scrape type 2
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d407ea1-43b5-510e-8d5f-6a931dbda60e with scrape type 2
2026-03-30 12:19:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9d407ea1-43b5-510e-8d5f-6a931dbda60e, identifier: EG10969
2026-03-30 12:19:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9d407ea1-43b5-510e-8d5f-6a931dbda60e with identifier: EG10969
2026-03-30 12:19:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9d407ea1-43b5-510e-8d5f-6a931dbda60e with identifier: EG10969
2026-03-30 12:19:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9d407ea1-43b5-510e-8d5f-6a931dbda60e with identifier: EG10969 to the API
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:56Z',
 'fuel_type': 'diesel',
 'id': '9d407ea1-43b5-510e-8d5f-6a931dbda60e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG10969',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 164019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-27',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG10969%27 HTTP/1.1" 200 None
2026-03-30 12:19:57 [auto1.nl] INFO: Saving data for EG10969: {'auction_closing_time': 1774884296.0, 'created_time': 1773134962.472984, 'last_price_update_time': 1774873197.22292}
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG10969') HTTP/1.1" 204 0
2026-03-30 12:19:57 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-30 12:19:57 [auto1.nl] INFO: Scrape type for RC67109: 2
2026-03-30 12:19:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109
2026-03-30 12:19:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02046a39-e875-5c34-a465-c0d2f2d80f26 with scrape type 2
2026-03-30 12:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02046a39-e875-5c34-a465-c0d2f2d80f26 with scrape type 2
2026-03-30 12:19:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02046a39-e875-5c34-a465-c0d2f2d80f26, identifier: RC67109
2026-03-30 12:19:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109
2026-03-30 12:19:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109
2026-03-30 12:19:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109 to the API
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-30T15:11:51Z',
 'fuel_type': 'diesel',
 'id': '02046a39-e875-5c34-a465-c0d2f2d80f26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC67109',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 182468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-06',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2012}
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-30 12:19:57 [auto1.nl] INFO: Saving data for RC67109: {'auction_closing_time': 1774883511.0, 'created_time': 1773232228.801859, 'last_price_update_time': 1774873197.711363}
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC67109') HTTP/1.1" 204 0
2026-03-30 12:19:57 [auto1.nl] INFO: Found listing with ID: KE96226
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE96226%27 HTTP/1.1" 200 None
2026-03-30 12:19:57 [auto1.nl] INFO: Scrape type for KE96226: 2
2026-03-30 12:19:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd33182-086a-5be8-9fcb-059e046c140a with identifier: KE96226
2026-03-30 12:19:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd33182-086a-5be8-9fcb-059e046c140a with scrape type 2
2026-03-30 12:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd33182-086a-5be8-9fcb-059e046c140a with scrape type 2
2026-03-30 12:19:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3fd33182-086a-5be8-9fcb-059e046c140a, identifier: KE96226
2026-03-30 12:19:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3fd33182-086a-5be8-9fcb-059e046c140a with identifier: KE96226
2026-03-30 12:19:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3fd33182-086a-5be8-9fcb-059e046c140a with identifier: KE96226
2026-03-30 12:19:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3fd33182-086a-5be8-9fcb-059e046c140a with identifier: KE96226 to the API
2026-03-30 12:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:52:25Z',
 'fuel_type': 'diesel',
 'id': '3fd33182-086a-5be8-9fcb-059e046c140a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE96226',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 217210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE96226%27 HTTP/1.1" 200 None
2026-03-30 12:19:58 [auto1.nl] INFO: Saving data for KE96226: {'auction_closing_time': 1774885945.0, 'created_time': 1773131834.172676, 'last_price_update_time': 1774873198.270513}
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KE96226') HTTP/1.1" 204 0
2026-03-30 12:19:58 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-30 12:19:58 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW61331%27 HTTP/1.1" 200 None
2026-03-30 12:19:58 [auto1.nl] INFO: Scrape type for VW61331: 2
2026-03-30 12:19:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 755b2e8d-43e1-5256-972d-0ee351e173ea with identifier: VW61331
2026-03-30 12:19:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 755b2e8d-43e1-5256-972d-0ee351e173ea with scrape type 2
2026-03-30 12:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 755b2e8d-43e1-5256-972d-0ee351e173ea with scrape type 2
2026-03-30 12:19:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 755b2e8d-43e1-5256-972d-0ee351e173ea, identifier: VW61331
2026-03-30 12:19:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 755b2e8d-43e1-5256-972d-0ee351e173ea with identifier: VW61331
2026-03-30 12:19:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 755b2e8d-43e1-5256-972d-0ee351e173ea with identifier: VW61331
2026-03-30 12:19:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 755b2e8d-43e1-5256-972d-0ee351e173ea with identifier: VW61331 to the API
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:05Z',
 'fuel_type': 'petrol',
 'id': '755b2e8d-43e1-5256-972d-0ee351e173ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW61331',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 301671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-15',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW61331%27 HTTP/1.1" 200 None
2026-03-30 12:19:58 [auto1.nl] INFO: Saving data for VW61331: {'auction_closing_time': 1774884725.0, 'created_time': 1773232264.907713, 'last_price_update_time': 1774873198.692867}
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VW61331') HTTP/1.1" 204 0
2026-03-30 12:19:58 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-30 12:19:58 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-30 12:19:58 [auto1.nl] INFO: Scrape type for DF82688: 2
2026-03-30 12:19:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688
2026-03-30 12:19:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with scrape type 2
2026-03-30 12:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with scrape type 2
2026-03-30 12:19:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3, identifier: DF82688
2026-03-30 12:19:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688
2026-03-30 12:19:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688
2026-03-30 12:19:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688 to the API
2026-03-30 12:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:14:15Z',
 'fuel_type': 'petrol',
 'id': '4d9c2f77-39b7-50fc-bc99-611b6d28b7a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF82688',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 51601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-30 12:19:59 [auto1.nl] INFO: Saving data for DF82688: {'auction_closing_time': 1774883655.0, 'created_time': 1773133345.831724, 'last_price_update_time': 1774873199.161153}
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF82688') HTTP/1.1" 204 0
2026-03-30 12:19:59 [auto1.nl] INFO: Found listing with ID: RH35225
2026-03-30 12:19:59 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-30 12:19:59 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-30 12:19:59 [auto1.nl] INFO: Found listing with ID: UE71777
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE71777%27 HTTP/1.1" 200 None
2026-03-30 12:19:59 [auto1.nl] INFO: Scrape type for UE71777: 2
2026-03-30 12:19:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 524ccbfd-57ae-56a8-8b00-607964da462e with identifier: UE71777
2026-03-30 12:19:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 524ccbfd-57ae-56a8-8b00-607964da462e with scrape type 2
2026-03-30 12:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 524ccbfd-57ae-56a8-8b00-607964da462e with scrape type 2
2026-03-30 12:19:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 524ccbfd-57ae-56a8-8b00-607964da462e, identifier: UE71777
2026-03-30 12:19:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 524ccbfd-57ae-56a8-8b00-607964da462e with identifier: UE71777
2026-03-30 12:19:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 524ccbfd-57ae-56a8-8b00-607964da462e with identifier: UE71777
2026-03-30 12:19:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 524ccbfd-57ae-56a8-8b00-607964da462e with identifier: UE71777 to the API
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:50Z',
 'fuel_type': 'petrol',
 'id': '524ccbfd-57ae-56a8-8b00-607964da462e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE71777',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 167198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-14',
 'seller_name': None,
 'title': 'Citroen C3 1.6 Exclusive SensoDrive',
 'transmission': 'automatic',
 'trim': 'Exclusive SensoDrive',
 'year': 2002}
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE71777%27 HTTP/1.1" 200 None
2026-03-30 12:19:59 [auto1.nl] INFO: Saving data for UE71777: {'auction_closing_time': 1774884770.0, 'created_time': 1774785655.335693, 'last_price_update_time': 1774873199.549844}
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE71777') HTTP/1.1" 204 0
2026-03-30 12:19:59 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-30 12:19:59 [auto1.nl] INFO: Scrape type for HV97203: 2
2026-03-30 12:19:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203
2026-03-30 12:19:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea8f8866-2ba3-532b-9d03-849dcc7e2468 with scrape type 2
2026-03-30 12:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea8f8866-2ba3-532b-9d03-849dcc7e2468 with scrape type 2
2026-03-30 12:19:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea8f8866-2ba3-532b-9d03-849dcc7e2468, identifier: HV97203
2026-03-30 12:19:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203
2026-03-30 12:19:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203
2026-03-30 12:19:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203 to the API
2026-03-30 12:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:59:29Z',
 'fuel_type': 'diesel',
 'id': 'ea8f8866-2ba3-532b-9d03-849dcc7e2468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV97203',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 240575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2015}
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [auto1.nl] INFO: Saving data for HV97203: {'auction_closing_time': 1774886369.0, 'created_time': 1773229528.959622, 'last_price_update_time': 1774873200.148798}
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HV97203') HTTP/1.1" 204 0
2026-03-30 12:20:00 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC71604%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [auto1.nl] INFO: Scrape type for UC71604: 2
2026-03-30 12:20:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14a3d914-dfa1-5086-980e-330ef6cc170a with identifier: UC71604
2026-03-30 12:20:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14a3d914-dfa1-5086-980e-330ef6cc170a with scrape type 2
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14a3d914-dfa1-5086-980e-330ef6cc170a with scrape type 2
2026-03-30 12:20:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14a3d914-dfa1-5086-980e-330ef6cc170a, identifier: UC71604
2026-03-30 12:20:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14a3d914-dfa1-5086-980e-330ef6cc170a with identifier: UC71604
2026-03-30 12:20:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14a3d914-dfa1-5086-980e-330ef6cc170a with identifier: UC71604
2026-03-30 12:20:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14a3d914-dfa1-5086-980e-330ef6cc170a with identifier: UC71604 to the API
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:27:01Z',
 'fuel_type': 'petrol',
 'id': '14a3d914-dfa1-5086-980e-330ef6cc170a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC71604',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 8025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-05',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2024}
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC71604%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [auto1.nl] INFO: Saving data for UC71604: {'auction_closing_time': 1774884421.0, 'created_time': 1773947302.099136, 'last_price_update_time': 1774873200.546582}
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC71604') HTTP/1.1" 204 0
2026-03-30 12:20:00 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-30 12:20:00 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-30 12:20:00 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [auto1.nl] INFO: Scrape type for HF10176: 2
2026-03-30 12:20:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176
2026-03-30 12:20:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c454cb49-c890-5f14-bd4c-482023415706 with scrape type 2
2026-03-30 12:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c454cb49-c890-5f14-bd4c-482023415706 with scrape type 2
2026-03-30 12:20:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c454cb49-c890-5f14-bd4c-482023415706, identifier: HF10176
2026-03-30 12:20:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176
2026-03-30 12:20:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176
2026-03-30 12:20:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176 to the API
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:30:42Z',
 'fuel_type': 'petrol',
 'id': 'c454cb49-c890-5f14-bd4c-482023415706',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF10176',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 27697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-17',
 'seller_name': None,
 'title': 'BMW 4er 420i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-30 12:20:00 [auto1.nl] INFO: Saving data for HF10176: {'auction_closing_time': 1774884642.0, 'created_time': 1774465377.781767, 'last_price_update_time': 1774873200.968787}
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HF10176') HTTP/1.1" 204 0
2026-03-30 12:20:00 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-30 12:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG79878%27 HTTP/1.1" 200 None
2026-03-30 12:20:01 [auto1.nl] INFO: Scrape type for UG79878: 2
2026-03-30 12:20:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79bc33e2-6592-5230-9735-db03c5432de8 with identifier: UG79878
2026-03-30 12:20:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bc33e2-6592-5230-9735-db03c5432de8 with scrape type 2
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79bc33e2-6592-5230-9735-db03c5432de8 with scrape type 2
2026-03-30 12:20:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 79bc33e2-6592-5230-9735-db03c5432de8, identifier: UG79878
2026-03-30 12:20:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 79bc33e2-6592-5230-9735-db03c5432de8 with identifier: UG79878
2026-03-30 12:20:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 79bc33e2-6592-5230-9735-db03c5432de8 with identifier: UG79878
2026-03-30 12:20:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 79bc33e2-6592-5230-9735-db03c5432de8 with identifier: UG79878 to the API
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:11:06Z',
 'fuel_type': 'petrol',
 'id': '79bc33e2-6592-5230-9735-db03c5432de8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG79878',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 397546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-09',
 'seller_name': None,
 'title': 'Renault Kangoo 1.6 Privilege',
 'transmission': 'manual',
 'trim': 'Privilege',
 'year': 2009}
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG79878%27 HTTP/1.1" 200 None
2026-03-30 12:20:01 [auto1.nl] INFO: Saving data for UG79878: {'auction_closing_time': 1774883466.0, 'created_time': 1774785656.264198, 'last_price_update_time': 1774873201.387891}
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UG79878') HTTP/1.1" 204 0
2026-03-30 12:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:01 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-30 12:20:01 [auto1.nl] INFO: Scrape type for RL18676: 2
2026-03-30 12:20:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676
2026-03-30 12:20:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with scrape type 2
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with scrape type 2
2026-03-30 12:20:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7888771b-1c1d-55e9-beb7-2c5bad3225a3, identifier: RL18676
2026-03-30 12:20:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676
2026-03-30 12:20:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676
2026-03-30 12:20:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676 to the API
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:37:36Z',
 'fuel_type': 'petrol',
 'id': '7888771b-1c1d-55e9-beb7-2c5bad3225a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL18676',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 64319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-04',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-30 12:20:01 [auto1.nl] INFO: Saving data for RL18676: {'auction_closing_time': 1774885056.0, 'created_time': 1773132401.211667, 'last_price_update_time': 1774873201.807484}
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RL18676') HTTP/1.1" 204 0
2026-03-30 12:20:01 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-30 12:20:01 [auto1.nl] INFO: Scrape type for FD60498: 2
2026-03-30 12:20:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498
2026-03-30 12:20:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with scrape type 2
2026-03-30 12:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with scrape type 2
2026-03-30 12:20:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e, identifier: FD60498
2026-03-30 12:20:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498
2026-03-30 12:20:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498
2026-03-30 12:20:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498 to the API
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:17:52Z',
 'fuel_type': 'petrol',
 'id': '90db204c-5894-5d7f-a3b0-b7b9efb29e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD60498',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 160960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.nl] INFO: Saving data for FD60498: {'auction_closing_time': 1774883872.0, 'created_time': 1773132796.498101, 'last_price_update_time': 1774873202.360793}
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD60498') HTTP/1.1" 204 0
2026-03-30 12:20:02 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 1030 | hits on page: 40
2026-03-30 12:20:02 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-30 12:20:02 [auto1.nl] INFO: Found listing with ID: VP11309
2026-03-30 12:20:02 [auto1.nl] INFO: Found listing with ID: GW54855
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW54855%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.nl] INFO: Scrape type for GW54855: 2
2026-03-30 12:20:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b64c25-e6d4-5417-919d-627f473fda70 with identifier: GW54855
2026-03-30 12:20:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b64c25-e6d4-5417-919d-627f473fda70 with scrape type 2
2026-03-30 12:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b64c25-e6d4-5417-919d-627f473fda70 with scrape type 2
2026-03-30 12:20:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 38b64c25-e6d4-5417-919d-627f473fda70, identifier: GW54855
2026-03-30 12:20:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 38b64c25-e6d4-5417-919d-627f473fda70 with identifier: GW54855
2026-03-30 12:20:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 38b64c25-e6d4-5417-919d-627f473fda70 with identifier: GW54855
2026-03-30 12:20:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 38b64c25-e6d4-5417-919d-627f473fda70 with identifier: GW54855 to the API
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:20:29Z',
 'fuel_type': 'diesel',
 'id': '38b64c25-e6d4-5417-919d-627f473fda70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW54855',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 328492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-08',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW54855%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.nl] INFO: Saving data for GW54855: {'auction_closing_time': 1774884029.0, 'created_time': 1773131927.613367, 'last_price_update_time': 1774873202.797322}
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW54855') HTTP/1.1" 204 0
2026-03-30 12:20:02 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.nl] INFO: Scrape type for VV23298: 0
2026-03-30 12:20:02 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-30 12:20:02 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-30 12:20:02 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-30 12:20:02 [auto1.nl] INFO: Scrape type for TA68954: 0
2026-03-30 12:20:02 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-30 12:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for MC92565: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for FB46775: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for HY50584: 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-30 12:20:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for XJ86601: 2
2026-03-30 12:20:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601
2026-03-30 12:20:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a74828f-287e-5201-9335-16a8f15c19f1 with scrape type 2
2026-03-30 12:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a74828f-287e-5201-9335-16a8f15c19f1 with scrape type 2
2026-03-30 12:20:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a74828f-287e-5201-9335-16a8f15c19f1, identifier: XJ86601
2026-03-30 12:20:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601
2026-03-30 12:20:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601
2026-03-30 12:20:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601 to the API
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:28:20Z',
 'fuel_type': 'petrol',
 'id': '1a74828f-287e-5201-9335-16a8f15c19f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ86601',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 102359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-15',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Saving data for XJ86601: {'auction_closing_time': 1774884500.0, 'created_time': 1773301459.292838, 'last_price_update_time': 1774873203.828375}
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ86601') HTTP/1.1" 204 0
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-30 12:20:03 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.nl] INFO: Scrape type for FT93592: 2
2026-03-30 12:20:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592
2026-03-30 12:20:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with scrape type 2
2026-03-30 12:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with scrape type 2
2026-03-30 12:20:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 50da3f30-d841-5fb5-a493-8e3e1c5feb15, identifier: FT93592
2026-03-30 12:20:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592
2026-03-30 12:20:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592
2026-03-30 12:20:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592 to the API
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:16Z',
 'fuel_type': 'diesel',
 'id': '50da3f30-d841-5fb5-a493-8e3e1c5feb15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT93592',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 143606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-07',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 35 L4 Heavy BlueHDi',
 'transmission': 'manual',
 'trim': '35 L4 Heavy BlueHDi',
 'year': 2018}
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.nl] INFO: Saving data for FT93592: {'auction_closing_time': 1774884376.0, 'created_time': 1773132799.005079, 'last_price_update_time': 1774873204.403504}
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FT93592') HTTP/1.1" 204 0
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT87192%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.nl] INFO: Scrape type for TT87192: 2
2026-03-30 12:20:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8adabe83-0ddc-567b-9799-ad5b268c02a3 with identifier: TT87192
2026-03-30 12:20:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8adabe83-0ddc-567b-9799-ad5b268c02a3 with scrape type 2
2026-03-30 12:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8adabe83-0ddc-567b-9799-ad5b268c02a3 with scrape type 2
2026-03-30 12:20:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8adabe83-0ddc-567b-9799-ad5b268c02a3, identifier: TT87192
2026-03-30 12:20:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8adabe83-0ddc-567b-9799-ad5b268c02a3 with identifier: TT87192
2026-03-30 12:20:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8adabe83-0ddc-567b-9799-ad5b268c02a3 with identifier: TT87192
2026-03-30 12:20:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8adabe83-0ddc-567b-9799-ad5b268c02a3 with identifier: TT87192 to the API
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:32:54Z',
 'fuel_type': 'petrol',
 'id': '8adabe83-0ddc-567b-9799-ad5b268c02a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT87192',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 306045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-19',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2006}
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT87192%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.nl] INFO: Saving data for TT87192: {'auction_closing_time': 1774884774.0, 'created_time': 1774785657.770673, 'last_price_update_time': 1774873204.817227}
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TT87192') HTTP/1.1" 204 0
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.nl] INFO: Scrape type for EP75091: 0
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.nl] INFO: Scrape type for PT29526: 0
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.nl] INFO: Scrape type for LT58475: 0
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.nl] INFO: Scrape type for ZU81802: 0
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-30 12:20:04 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-30 12:20:04 [auto1.nl] INFO: Scrape type for AR18023: 0
2026-03-30 12:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:06 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 1030 | hits on page: 40
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for HK41309: 2
2026-03-30 12:20:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-30 12:20:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with scrape type 2
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with scrape type 2
2026-03-30 12:20:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040, identifier: HK41309
2026-03-30 12:20:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-30 12:20:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-30 12:20:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309 to the API
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:40:11Z',
 'fuel_type': 'petrol',
 'id': '5dc5bb30-2b38-5c98-8921-aa6df8ff1040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK41309',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 186806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-25',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Saving data for HK41309: {'auction_closing_time': 1774885211.0, 'created_time': 1773301820.159804, 'last_price_update_time': 1774873206.433258}
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK41309') HTTP/1.1" 204 0
2026-03-30 12:20:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for ET47420: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for GS47094: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for FP10265: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for LZ16255: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for PY50820: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for YN14337: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for UD40907: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [auto1.nl] INFO: Scrape type for MB44193: 0
2026-03-30 12:20:06 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-30 12:20:07 [auto1.nl] INFO: Scrape type for LG57021: 0
2026-03-30 12:20:07 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-30 12:20:07 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-30 12:20:07 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-30 12:20:07 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-30 12:20:07 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-30 12:20:07 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-30 12:20:07 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-30 12:20:07 [scrapy.extensions.logstats] INFO: Crawled 138 pages (at 6 pages/min), scraped 181 items (at 54 items/min)
2026-03-30 12:20:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV30103> (referer: https://www.auto1.com/v1/car-details-view/SV30103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e56ac570-1e73-5aad-8af9-9b65d000e18c with identifier: SV30103
2026-03-30 12:20:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e56ac570-1e73-5aad-8af9-9b65d000e18c with scrape type 1
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e56ac570-1e73-5aad-8af9-9b65d000e18c
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F9a%252Fd49a9dff7e68e023b21ab4d226c3eefa%252Fpa%252FSV30103_ddc9b57099add4cd033abedb825851f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_ddc9b57099add4cd033abedb825851f2.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F9a%252Fd49a9dff7e68e023b21ab4d226c3eefa%252Fpa%252FSV30103_ad5dfa33597b06589402582230d673a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_ad5dfa33597b06589402582230d673a9.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F9a%252Fd49a9dff7e68e023b21ab4d226c3eefa%252Fpa%252FSV30103_cb246e78168df7b367ae76664534f38a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_cb246e78168df7b367ae76664534f38a.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F9a%252Fd49a9dff7e68e023b21ab4d226c3eefa%252Fpa%252FSV30103_3eec5ba00834e5bbacd186e5053b5f0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_3eec5ba00834e5bbacd186e5053b5f0d.jpg already downloaded
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F9a%252Fd49a9dff7e68e023b21ab4d226c3eefa%252Fpa%252FSV30103_be10d958b39a294eaf9e72c80f0ffae9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_be10d958b39a294eaf9e72c80f0ffae9.jpg already downloaded
2026-03-30 12:20:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e56ac570-1e73-5aad-8af9-9b65d000e18c, identifier: SV30103
2026-03-30 12:20:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e56ac570-1e73-5aad-8af9-9b65d000e18c with identifier: SV30103
2026-03-30 12:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e56ac570-1e73-5aad-8af9-9b65d000e18c with identifier: SV30103
2026-03-30 12:20:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e56ac570-1e73-5aad-8af9-9b65d000e18c with identifier: SV30103 to the API
2026-03-30 12:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV30103>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:06:10Z',
 'fuel_type': 'petrol',
 'id': 'e56ac570-1e73-5aad-8af9-9b65d000e18c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '29-XJX-6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV30103',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 235239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_ddc9b57099add4cd033abedb825851f2.jpg',
                'https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_ad5dfa33597b06589402582230d673a9.jpg',
                'https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_cb246e78168df7b367ae76664534f38a.jpg',
                'https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_3eec5ba00834e5bbacd186e5053b5f0d.jpg',
                'https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_be10d958b39a294eaf9e72c80f0ffae9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ac570-1e73-5aad-8af9-9b65d000e18c/e56ac570-1e73-5aad-8af9-9b65d000e18c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_ddc9b57099add4cd033abedb825851f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ac570-1e73-5aad-8af9-9b65d000e18c/e56ac570-1e73-5aad-8af9-9b65d000e18c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_ad5dfa33597b06589402582230d673a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ac570-1e73-5aad-8af9-9b65d000e18c/e56ac570-1e73-5aad-8af9-9b65d000e18c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_cb246e78168df7b367ae76664534f38a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ac570-1e73-5aad-8af9-9b65d000e18c/e56ac570-1e73-5aad-8af9-9b65d000e18c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_3eec5ba00834e5bbacd186e5053b5f0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56ac570-1e73-5aad-8af9-9b65d000e18c/e56ac570-1e73-5aad-8af9-9b65d000e18c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/9a/d49a9dff7e68e023b21ab4d226c3eefa/pa/SV30103_be10d958b39a294eaf9e72c80f0ffae9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV30103%27 HTTP/1.1" 200 None
2026-03-30 12:20:24 [auto1.nl] INFO: Saving data for SV30103: {'created_time': 1774873224.194, 'last_price_update_time': 1774873224.19401, 'auction_closing_time': 1774969570.0}
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV30103') HTTP/1.1" 204 0
2026-03-30 12:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:39 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 1030 | hits on page: 40
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM45476%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for VM45476: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for RT28324: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for MW16655: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for TN92622: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE99372%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for SE99372: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for MD48743: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-30 12:20:39 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-30 12:20:39 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-30 12:20:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:07 [scrapy.extensions.logstats] INFO: Crawled 140 pages (at 2 pages/min), scraped 182 items (at 1 items/min)
2026-03-30 12:21:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:21:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 398.982(s), this was the 3rd time calling it.
2026-03-30 12:21:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.94509837571891 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:22:07 [scrapy.extensions.logstats] INFO: Crawled 140 pages (at 0 pages/min), scraped 182 items (at 0 items/min)
2026-03-30 12:22:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:22:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.521(s), this was the 1st time calling it.
2026-03-30 12:22:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.278830930870259 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:22:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:56 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 1032 | hits on page: 40
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for LK58980: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for LD78562: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for NL71418: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for YW81523: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for KK56723: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for UJ24113: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for ZC66376: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for DF87411: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for HX69861: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for SD33545: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for VA79192: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for DK58919: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for WH69219: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-30 12:22:56 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-30 12:22:56 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-30 12:22:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:01 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 1032 | hits on page: 40
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for FU31497: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for HZ82321: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for ZX63291: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for LL90951: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for JT64166: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for XA85497: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for MX82019: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for WS29354: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for LT61011: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for NK23750: 0
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-30 12:23:01 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-30 12:23:01 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-30 12:23:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:07 [scrapy.extensions.logstats] INFO: Crawled 142 pages (at 2 pages/min), scraped 182 items (at 0 items/min)
2026-03-30 12:23:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:23:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 536.198(s), this was the 4th time calling it.
2026-03-30 12:23:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.586238631532193 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2026-03-30 12:24:07 [scrapy.extensions.logstats] INFO: Crawled 142 pages (at 0 pages/min), scraped 182 items (at 0 items/min)
2026-03-30 12:24:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:25:07 [scrapy.extensions.logstats] INFO: Crawled 142 pages (at 0 pages/min), scraped 182 items (at 0 items/min)
2026-03-30 12:25:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:25:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.955(s), this was the 1st time calling it.
2026-03-30 12:25:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.16784732279664 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:25:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:24 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 1032 | hits on page: 40
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for VJ86590: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for EK38089: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for ZD26534: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for PG46787: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for HB03885: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for CG77801: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for CU35423: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW28642%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for XW28642: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-30 12:25:24 [auto1.nl] INFO: Scrape type for RF39867: 0
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-30 12:25:24 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-30 12:25:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:29 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 1032 | hits on page: 40
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for WZ36257: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for KD04773: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF74705%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for UF74705: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for SA72680: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for WC55998: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for EN44222: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for VH08569: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for AY58936: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for XJ71773: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for LF75031: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for PP29341: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-30 12:25:29 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [auto1.nl] INFO: Scrape type for FC33520: 0
2026-03-30 12:25:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:38 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 1032 | hits on page: 40
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for NF23683: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for CR43638: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for LH66044: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for DA29812: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for AM42063: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for EM66057: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for AL57491: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for PD24155: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for ML76723: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for JN86544: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for GY00070: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-30 12:25:38 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [auto1.nl] INFO: Scrape type for DD65196: 0
2026-03-30 12:25:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:40 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 1032 | hits on page: 40
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for CC90793: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for LG18300: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for RF14080: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for JA96094: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for RM92541: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-30 12:25:40 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS97590%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for LS97590: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for HX62169: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for XY26028: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for RY51498: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for VC22580: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for HR88481: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for KP34214: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for SL12489: 0
2026-03-30 12:25:41 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.nl] INFO: Scrape type for PB89826: 0
2026-03-30 12:25:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 673.418(s), this was the 5th time calling it.
2026-03-30 12:25:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.876864438280131 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:26:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 6th time calling it.
2026-03-30 12:26:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:01 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 1032 | hits on page: 40
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for RY20438: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for JC34887: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for AA56023: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for UA44354: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for KV59291: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for WZ30415: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for CY67010: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for PZ30163: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for JP82620: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for TP38124: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-30 12:26:01 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-30 12:26:01 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-30 12:26:02 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-30 12:26:02 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-30 12:26:02 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-30 12:26:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:07 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 5 pages/min), scraped 182 items (at 0 items/min)
2026-03-30 12:26:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:26:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA42308> (referer: https://www.auto1.com/v1/car-details-view/TA42308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d603db3-2599-5737-bf8d-744e4d203c7f with identifier: TA42308
2026-03-30 12:26:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d603db3-2599-5737-bf8d-744e4d203c7f with scrape type 1
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5d603db3-2599-5737-bf8d-744e4d203c7f
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9b%252Fbe9b10b2006e0b57b368404fd16e8c23%252Fpa%252FTA42308_0f2dd5bf8ab5e7daaf80c875cf012fcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_0f2dd5bf8ab5e7daaf80c875cf012fcb.jpg already downloaded
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9b%252Fbe9b10b2006e0b57b368404fd16e8c23%252Fpa%252FTA42308_29e0f1e747f2880fe69e4442cd202397.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_29e0f1e747f2880fe69e4442cd202397.jpg already downloaded
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9b%252Fbe9b10b2006e0b57b368404fd16e8c23%252Fpa%252FTA42308_7da06c7e691b847a1f0d64015677a45e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_7da06c7e691b847a1f0d64015677a45e.jpg already downloaded
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9b%252Fbe9b10b2006e0b57b368404fd16e8c23%252Fpa%252FTA42308_1910fa703e1974acc420e426e899ec46.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_1910fa703e1974acc420e426e899ec46.jpg already downloaded
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F9b%252Fbe9b10b2006e0b57b368404fd16e8c23%252Fpa%252FTA42308_6f48dc1da5c68dffce08c15ca7dbd772.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_6f48dc1da5c68dffce08c15ca7dbd772.jpg already downloaded
2026-03-30 12:26:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5d603db3-2599-5737-bf8d-744e4d203c7f, identifier: TA42308
2026-03-30 12:26:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5d603db3-2599-5737-bf8d-744e4d203c7f with identifier: TA42308
2026-03-30 12:26:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5d603db3-2599-5737-bf8d-744e4d203c7f with identifier: TA42308
2026-03-30 12:26:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5d603db3-2599-5737-bf8d-744e4d203c7f with identifier: TA42308 to the API
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TA42308>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:45:16Z',
 'fuel_type': 'petrol',
 'id': '5d603db3-2599-5737-bf8d-744e4d203c7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '61TXJ7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA42308',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 209214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_0f2dd5bf8ab5e7daaf80c875cf012fcb.jpg',
                'https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_29e0f1e747f2880fe69e4442cd202397.jpg',
                'https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_7da06c7e691b847a1f0d64015677a45e.jpg',
                'https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_1910fa703e1974acc420e426e899ec46.jpg',
                'https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_6f48dc1da5c68dffce08c15ca7dbd772.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d603db3-2599-5737-bf8d-744e4d203c7f/5d603db3-2599-5737-bf8d-744e4d203c7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_0f2dd5bf8ab5e7daaf80c875cf012fcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d603db3-2599-5737-bf8d-744e4d203c7f/5d603db3-2599-5737-bf8d-744e4d203c7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_29e0f1e747f2880fe69e4442cd202397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d603db3-2599-5737-bf8d-744e4d203c7f/5d603db3-2599-5737-bf8d-744e4d203c7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_7da06c7e691b847a1f0d64015677a45e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d603db3-2599-5737-bf8d-744e4d203c7f/5d603db3-2599-5737-bf8d-744e4d203c7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_1910fa703e1974acc420e426e899ec46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d603db3-2599-5737-bf8d-744e4d203c7f/5d603db3-2599-5737-bf8d-744e4d203c7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/9b/be9b10b2006e0b57b368404fd16e8c23/pa/TA42308_6f48dc1da5c68dffce08c15ca7dbd772.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA42308%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [auto1.nl] INFO: Saving data for TA42308: {'created_time': 1774873570.066836, 'last_price_update_time': 1774873570.066847, 'auction_closing_time': 1774971916.0}
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA42308') HTTP/1.1" 204 0
2026-03-30 12:27:07 [scrapy.extensions.logstats] INFO: Crawled 148 pages (at 1 pages/min), scraped 183 items (at 1 items/min)
2026-03-30 12:27:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:28:07 [scrapy.extensions.logstats] INFO: Crawled 148 pages (at 0 pages/min), scraped 183 items (at 0 items/min)
2026-03-30 12:28:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:28:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.164(s), this was the 1st time calling it.
2026-03-30 12:28:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.56497196804666 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:28:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:20 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 1036 | hits on page: 40
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for CD92062: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for WR76222: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for XY00413: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX73700%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for MX73700: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for KW64079: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV91252%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for GV91252: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE70887%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for VE70887: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY41517%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [auto1.nl] INFO: Scrape type for TY41517: 0
2026-03-30 12:28:20 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-30 12:28:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:41 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 1036 | hits on page: 40
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-30 12:28:41 [auto1.nl] INFO: Scrape type for WP58537: 0
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE21715%27 HTTP/1.1" 200 None
2026-03-30 12:28:41 [auto1.nl] INFO: Scrape type for LE21715: 0
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH71745%27 HTTP/1.1" 200 None
2026-03-30 12:28:41 [auto1.nl] INFO: Scrape type for JH71745: 0
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-30 12:28:41 [auto1.nl] INFO: Scrape type for BL89669: 0
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN54837%27 HTTP/1.1" 200 None
2026-03-30 12:28:41 [auto1.nl] INFO: Scrape type for HN54837: 0
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK63885%27 HTTP/1.1" 200 None
2026-03-30 12:28:41 [auto1.nl] INFO: Scrape type for XK63885: 0
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ61509%27 HTTP/1.1" 200 None
2026-03-30 12:28:41 [auto1.nl] INFO: Scrape type for BJ61509: 0
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-30 12:28:41 [auto1.nl] INFO: Scrape type for RH72913: 0
2026-03-30 12:28:41 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-30 12:28:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR45817%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for SR45817: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC40520%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for EC40520: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL30088%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for LL30088: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN61945%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for SN61945: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for ZK31432: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN14496%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for GN14496: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for WH58354: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ88435%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for VZ88435: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK58084%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for ZK58084: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN70459%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for ZN70459: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE67699%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for FE67699: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU82529%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for XU82529: 0
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-30 12:28:42 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ65695%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [auto1.nl] INFO: Scrape type for VZ65695: 0
2026-03-30 12:28:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:43 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 1036 | hits on page: 40
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU70185%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for GU70185: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD33520%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for GD33520: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS01910%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for PS01910: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54003%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for AB54003: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD36341%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for HD36341: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA81822%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for JA81822: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA39510%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for JA39510: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD33035%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for AD33035: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ31093%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for NJ31093: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for YZ13462: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06198%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for LE06198: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32084%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for HW32084: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW29368%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for EW29368: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW56966%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for UW56966: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for YF94322: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for PK76759: 0
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-30 12:28:43 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-30 12:28:43 [auto1.nl] INFO: Scrape type for GA63942: 2
2026-03-30 12:28:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942
2026-03-30 12:28:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a812abb7-90f9-58e3-b4be-ec9a14d651d5 with scrape type 2
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a812abb7-90f9-58e3-b4be-ec9a14d651d5 with scrape type 2
2026-03-30 12:28:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a812abb7-90f9-58e3-b4be-ec9a14d651d5, identifier: GA63942
2026-03-30 12:28:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942
2026-03-30 12:28:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942
2026-03-30 12:28:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942 to the API
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:19Z',
 'fuel_type': 'petrol',
 'id': 'a812abb7-90f9-58e3-b4be-ec9a14d651d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA63942',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 150632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-01',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 I-Way',
 'transmission': 'automatic',
 'trim': 'I-Way',
 'year': 2011}
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-30 12:28:44 [auto1.nl] INFO: Saving data for GA63942: {'auction_closing_time': 1774883059.0, 'created_time': 1774699233.180321, 'last_price_update_time': 1774873724.950151}
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA63942') HTTP/1.1" 204 0
2026-03-30 12:28:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:45 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-30 12:28:45 [auto1.nl] INFO: Scrape type for XH80509: 0
2026-03-30 12:28:45 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-30 12:28:45 [auto1.nl] INFO: Scrape type for ND88147: 2
2026-03-30 12:28:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147
2026-03-30 12:28:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 387baa92-9d7d-52d8-ab82-6a055485c20b with scrape type 2
2026-03-30 12:28:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 387baa92-9d7d-52d8-ab82-6a055485c20b with scrape type 2
2026-03-30 12:28:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 387baa92-9d7d-52d8-ab82-6a055485c20b, identifier: ND88147
2026-03-30 12:28:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 12:28:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:28:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147
2026-03-30 12:28:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147 to the API
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:20:33Z',
 'fuel_type': 'petrol',
 'id': '387baa92-9d7d-52d8-ab82-6a055485c20b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND88147',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 271602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-30',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-30 12:28:45 [auto1.nl] INFO: Saving data for ND88147: {'auction_closing_time': 1774884033.0, 'created_time': 1774699235.579411, 'last_price_update_time': 1774873725.663284}
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ND88147') HTTP/1.1" 204 0
2026-03-30 12:28:45 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-30 12:28:45 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-30 12:28:45 [auto1.nl] INFO: Scrape type for WE18316: 0
2026-03-30 12:28:45 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-30 12:28:45 [auto1.nl] INFO: Scrape type for SS74343: 0
2026-03-30 12:28:45 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-30 12:28:45 [auto1.nl] INFO: Scrape type for YZ60467: 2
2026-03-30 12:28:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467
2026-03-30 12:28:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 348a5638-421f-592d-9f06-e9ad8871cc4f with scrape type 2
2026-03-30 12:28:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 348a5638-421f-592d-9f06-e9ad8871cc4f with scrape type 2
2026-03-30 12:28:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 348a5638-421f-592d-9f06-e9ad8871cc4f, identifier: YZ60467
2026-03-30 12:28:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467
2026-03-30 12:28:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467
2026-03-30 12:28:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467 to the API
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:18:54Z',
 'fuel_type': 'petrol',
 'id': '348a5638-421f-592d-9f06-e9ad8871cc4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ60467',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 59795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-23',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2015}
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-30 12:28:46 [auto1.nl] INFO: Saving data for YZ60467: {'auction_closing_time': 1774883934.0, 'created_time': 1774699266.66846, 'last_price_update_time': 1774873726.106527}
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ60467') HTTP/1.1" 204 0
2026-03-30 12:28:46 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-30 12:28:46 [auto1.nl] INFO: Scrape type for MZ09465: 0
2026-03-30 12:28:46 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-30 12:28:46 [auto1.nl] INFO: Scrape type for EG04578: 0
2026-03-30 12:28:46 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-30 12:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:47 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 1036 | hits on page: 40
2026-03-30 12:28:47 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-30 12:28:47 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-30 12:28:47 [auto1.nl] INFO: Scrape type for PJ49676: 2
2026-03-30 12:28:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676
2026-03-30 12:28:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a98ae1-87c8-5da9-b298-6807c53e5094 with scrape type 2
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91a98ae1-87c8-5da9-b298-6807c53e5094 with scrape type 2
2026-03-30 12:28:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 91a98ae1-87c8-5da9-b298-6807c53e5094, identifier: PJ49676
2026-03-30 12:28:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676
2026-03-30 12:28:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676
2026-03-30 12:28:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676 to the API
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:03:20Z',
 'fuel_type': 'diesel',
 'id': '91a98ae1-87c8-5da9-b298-6807c53e5094',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ49676',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 231536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 320 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2003}
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-30 12:28:47 [auto1.nl] INFO: Saving data for PJ49676: {'auction_closing_time': 1774883000.0, 'created_time': 1774008047.136506, 'last_price_update_time': 1774873727.547578}
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PJ49676') HTTP/1.1" 204 0
2026-03-30 12:28:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:47 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-30 12:28:47 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-30 12:28:47 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-30 12:28:47 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-30 12:28:47 [auto1.nl] INFO: Scrape type for TL29950: 0
2026-03-30 12:28:47 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-30 12:28:47 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-30 12:28:47 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-30 12:28:47 [auto1.nl] INFO: Scrape type for GZ48867: 2
2026-03-30 12:28:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867
2026-03-30 12:28:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c87a53e-b4c9-587f-b08f-930448a40f7d with scrape type 2
2026-03-30 12:28:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c87a53e-b4c9-587f-b08f-930448a40f7d with scrape type 2
2026-03-30 12:28:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0c87a53e-b4c9-587f-b08f-930448a40f7d, identifier: GZ48867
2026-03-30 12:28:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867
2026-03-30 12:28:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867
2026-03-30 12:28:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867 to the API
2026-03-30 12:28:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:15:52Z',
 'fuel_type': 'hybrid',
 'id': '0c87a53e-b4c9-587f-b08f-930448a40f7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ48867',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 117350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seller_name': None,
 'title': 'Audi Q5 Sportback 55 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-30 12:28:48 [auto1.nl] INFO: Saving data for GZ48867: {'auction_closing_time': 1774883752.0, 'created_time': 1774465315.20143, 'last_price_update_time': 1774873728.250235}
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GZ48867') HTTP/1.1" 204 0
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-30 12:28:48 [auto1.nl] INFO: Scrape type for ZB71006: 2
2026-03-30 12:28:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006
2026-03-30 12:28:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5333bba5-93d3-52c1-b6ec-9f61023e9919 with scrape type 2
2026-03-30 12:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5333bba5-93d3-52c1-b6ec-9f61023e9919 with scrape type 2
2026-03-30 12:28:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5333bba5-93d3-52c1-b6ec-9f61023e9919, identifier: ZB71006
2026-03-30 12:28:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006
2026-03-30 12:28:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006
2026-03-30 12:28:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006 to the API
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:10:44Z',
 'fuel_type': 'hybrid',
 'id': '5333bba5-93d3-52c1-b6ec-9f61023e9919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB71006',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 184309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2016}
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-30 12:28:48 [auto1.nl] INFO: Saving data for ZB71006: {'auction_closing_time': 1774883444.0, 'created_time': 1774699267.979346, 'last_price_update_time': 1774873728.775149}
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZB71006') HTTP/1.1" 204 0
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-30 12:28:48 [auto1.nl] INFO: Scrape type for DU11939: 0
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-30 12:28:48 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-30 12:28:48 [auto1.nl] INFO: Scrape type for KK51574: 2
2026-03-30 12:28:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574
2026-03-30 12:28:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with scrape type 2
2026-03-30 12:28:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with scrape type 2
2026-03-30 12:28:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1c961ab1-82f0-50e8-8c69-306cd09de1a7, identifier: KK51574
2026-03-30 12:28:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574
2026-03-30 12:28:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574
2026-03-30 12:28:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574 to the API
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:30:53Z',
 'fuel_type': 'petrol',
 'id': '1c961ab1-82f0-50e8-8c69-306cd09de1a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK51574',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 125968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-19',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2010}
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [auto1.nl] INFO: Saving data for KK51574: {'auction_closing_time': 1774884653.0, 'created_time': 1774699264.702174, 'last_price_update_time': 1774873729.456541}
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KK51574') HTTP/1.1" 204 0
2026-03-30 12:28:49 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [auto1.nl] INFO: Scrape type for AK27162: 2
2026-03-30 12:28:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162
2026-03-30 12:28:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29dff94-6ab8-5f78-aa8c-49d7297720b8 with scrape type 2
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29dff94-6ab8-5f78-aa8c-49d7297720b8 with scrape type 2
2026-03-30 12:28:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a29dff94-6ab8-5f78-aa8c-49d7297720b8, identifier: AK27162
2026-03-30 12:28:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162
2026-03-30 12:28:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162
2026-03-30 12:28:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162 to the API
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:56:17Z',
 'fuel_type': 'petrol',
 'id': 'a29dff94-6ab8-5f78-aa8c-49d7297720b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK27162',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 162951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-17',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [auto1.nl] INFO: Saving data for AK27162: {'auction_closing_time': 1774886177.0, 'created_time': 1774699272.488038, 'last_price_update_time': 1774873729.884234}
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AK27162') HTTP/1.1" 204 0
2026-03-30 12:28:49 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-30 12:28:49 [auto1.nl] INFO: Scrape type for KX15971: 2
2026-03-30 12:28:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971
2026-03-30 12:28:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with scrape type 2
2026-03-30 12:28:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with scrape type 2
2026-03-30 12:28:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54, identifier: KX15971
2026-03-30 12:28:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971
2026-03-30 12:28:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971
2026-03-30 12:28:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971 to the API
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:00:17Z',
 'fuel_type': 'petrol',
 'id': '890261b5-6ca7-5909-a7a9-ad57bf3e6b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX15971',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 101873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-28',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [auto1.nl] INFO: Saving data for KX15971: {'auction_closing_time': 1774882817.0, 'created_time': 1774699265.217792, 'last_price_update_time': 1774873730.352639}
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX15971') HTTP/1.1" 204 0
2026-03-30 12:28:50 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [auto1.nl] INFO: Scrape type for MV10901: 2
2026-03-30 12:28:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901
2026-03-30 12:28:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with scrape type 2
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with scrape type 2
2026-03-30 12:28:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9, identifier: MV10901
2026-03-30 12:28:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901
2026-03-30 12:28:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901
2026-03-30 12:28:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901 to the API
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:26:42Z',
 'fuel_type': 'diesel',
 'id': '0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV10901',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 292618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-11',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2014}
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [auto1.nl] INFO: Saving data for MV10901: {'auction_closing_time': 1774884402.0, 'created_time': 1773861244.096813, 'last_price_update_time': 1774873730.748137}
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MV10901') HTTP/1.1" 204 0
2026-03-30 12:28:50 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-30 12:28:50 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-30 12:28:50 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-30 12:28:50 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-30 12:28:50 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-30 12:28:50 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [auto1.nl] INFO: Scrape type for ZT51900: 2
2026-03-30 12:28:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900
2026-03-30 12:28:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49421184-a919-54bd-8e77-7aa2fe6a62d1 with scrape type 2
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49421184-a919-54bd-8e77-7aa2fe6a62d1 with scrape type 2
2026-03-30 12:28:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 49421184-a919-54bd-8e77-7aa2fe6a62d1, identifier: ZT51900
2026-03-30 12:28:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900
2026-03-30 12:28:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900
2026-03-30 12:28:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900 to the API
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'diesel',
 'id': '49421184-a919-54bd-8e77-7aa2fe6a62d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT51900',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 249395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-04',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Basis',
 'transmission': 'manual',
 'trim': 'Rapid Basis',
 'year': 2010}
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-30 12:28:51 [auto1.nl] INFO: Saving data for ZT51900: {'auction_closing_time': 1774882852.0, 'created_time': 1774699269.170171, 'last_price_update_time': 1774873731.186567}
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZT51900') HTTP/1.1" 204 0
2026-03-30 12:28:51 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-30 12:28:51 [auto1.nl] INFO: Scrape type for GN27243: 0
2026-03-30 12:28:51 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-30 12:28:51 [auto1.nl] INFO: Scrape type for NU66962: 2
2026-03-30 12:28:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962
2026-03-30 12:28:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6803cc5-9c85-5100-a40c-c7330b413d80 with scrape type 2
2026-03-30 12:28:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6803cc5-9c85-5100-a40c-c7330b413d80 with scrape type 2
2026-03-30 12:28:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f6803cc5-9c85-5100-a40c-c7330b413d80, identifier: NU66962
2026-03-30 12:28:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962
2026-03-30 12:28:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962
2026-03-30 12:28:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962 to the API
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'petrol',
 'id': 'f6803cc5-9c85-5100-a40c-c7330b413d80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU66962',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 159586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-21',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 4x2 Active',
 'transmission': 'manual',
 'trim': '4x2 Active',
 'year': 2020}
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [auto1.nl] INFO: Saving data for NU66962: {'auction_closing_time': 1774882938.0, 'created_time': 1774699247.348726, 'last_price_update_time': 1774873732.511381}
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NU66962') HTTP/1.1" 204 0
2026-03-30 12:28:52 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [auto1.nl] INFO: Scrape type for VY08351: 0
2026-03-30 12:28:52 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [auto1.nl] INFO: Scrape type for XR71865: 2
2026-03-30 12:28:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865
2026-03-30 12:28:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c2eb86-b403-52aa-a592-971506686848 with scrape type 2
2026-03-30 12:28:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8c2eb86-b403-52aa-a592-971506686848 with scrape type 2
2026-03-30 12:28:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e8c2eb86-b403-52aa-a592-971506686848, identifier: XR71865
2026-03-30 12:28:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865
2026-03-30 12:28:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865
2026-03-30 12:28:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865 to the API
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:27:41Z',
 'fuel_type': 'electro',
 'id': 'e8c2eb86-b403-52aa-a592-971506686848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR71865',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 85102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Opel Corsa electric drive 100 kW Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2020}
2026-03-30 12:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-30 12:28:54 [auto1.nl] INFO: Saving data for XR71865: {'auction_closing_time': 1774884461.0, 'created_time': 1774699245.717151, 'last_price_update_time': 1774873734.00416}
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XR71865') HTTP/1.1" 204 0
2026-03-30 12:28:54 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-30 12:28:54 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-30 12:28:54 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-30 12:28:54 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-30 12:28:54 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-30 12:28:54 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-30 12:28:54 [auto1.nl] INFO: Scrape type for YA06880: 2
2026-03-30 12:28:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880
2026-03-30 12:28:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd4db4de-0d3b-545b-a982-fe02e5dc0961 with scrape type 2
2026-03-30 12:28:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd4db4de-0d3b-545b-a982-fe02e5dc0961 with scrape type 2
2026-03-30 12:28:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd4db4de-0d3b-545b-a982-fe02e5dc0961, identifier: YA06880
2026-03-30 12:28:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880
2026-03-30 12:28:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880
2026-03-30 12:28:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880 to the API
2026-03-30 12:28:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:44:40Z',
 'fuel_type': 'diesel',
 'id': 'cd4db4de-0d3b-545b-a982-fe02e5dc0961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA06880',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 377969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-08',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [auto1.nl] INFO: Saving data for YA06880: {'auction_closing_time': 1774885480.0, 'created_time': 1774699242.645578, 'last_price_update_time': 1774873735.56085}
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YA06880') HTTP/1.1" 204 0
2026-03-30 12:28:55 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-30 12:28:55 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-30 12:28:55 [auto1.nl] INFO: Scrape type for SE60245: 2
2026-03-30 12:28:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245
2026-03-30 12:28:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414e65a8-2fea-5288-b188-ea04bd4434a8 with scrape type 2
2026-03-30 12:28:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 414e65a8-2fea-5288-b188-ea04bd4434a8 with scrape type 2
2026-03-30 12:28:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 414e65a8-2fea-5288-b188-ea04bd4434a8, identifier: SE60245
2026-03-30 12:28:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245
2026-03-30 12:28:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245
2026-03-30 12:28:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245 to the API
2026-03-30 12:28:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:31:06Z',
 'fuel_type': 'electro',
 'id': '414e65a8-2fea-5288-b188-ea04bd4434a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE60245',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 171944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Life Pro Performance',
 'transmission': 'automatic',
 'trim': 'Life Pro Performance',
 'year': 2021}
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-30 12:28:56 [auto1.nl] INFO: Saving data for SE60245: {'auction_closing_time': 1774884666.0, 'created_time': 1774699261.351577, 'last_price_update_time': 1774873736.873016}
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE60245') HTTP/1.1" 204 0
2026-03-30 12:28:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:57 [auto1.nl] INFO: Channel: 24h | Page: 25 | totalHits: 1036 | hits on page: 40
2026-03-30 12:28:57 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.nl] INFO: Scrape type for KL38892: 2
2026-03-30 12:28:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892
2026-03-30 12:28:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c62f588c-3746-59a5-a305-46f68cb734f2 with scrape type 2
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c62f588c-3746-59a5-a305-46f68cb734f2 with scrape type 2
2026-03-30 12:28:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c62f588c-3746-59a5-a305-46f68cb734f2, identifier: KL38892
2026-03-30 12:28:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892
2026-03-30 12:28:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892
2026-03-30 12:28:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892 to the API
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:00:26Z',
 'fuel_type': 'electro',
 'id': 'c62f588c-3746-59a5-a305-46f68cb734f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL38892',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 169017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seller_name': None,
 'title': 'Skoda Enyaq iV 80 Loft',
 'transmission': 'automatic',
 'trim': 'Loft',
 'year': 2022}
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.nl] INFO: Saving data for KL38892: {'auction_closing_time': 1774882826.0, 'created_time': 1774699248.635205, 'last_price_update_time': 1774873737.667534}
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KL38892') HTTP/1.1" 204 0
2026-03-30 12:28:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:57 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-30 12:28:57 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.nl] INFO: Scrape type for TW61693: 2
2026-03-30 12:28:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693
2026-03-30 12:28:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05571255-8b87-538b-af8f-7daefb19c9bf with scrape type 2
2026-03-30 12:28:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05571255-8b87-538b-af8f-7daefb19c9bf with scrape type 2
2026-03-30 12:28:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 05571255-8b87-538b-af8f-7daefb19c9bf, identifier: TW61693
2026-03-30 12:28:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693
2026-03-30 12:28:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693
2026-03-30 12:28:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693 to the API
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:33:56Z',
 'fuel_type': 'petrol',
 'id': '05571255-8b87-538b-af8f-7daefb19c9bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW61693',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 174156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-17',
 'seller_name': None,
 'title': 'MINI One Minimalist',
 'transmission': 'manual',
 'trim': 'Minimalist',
 'year': 2011}
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.nl] INFO: Saving data for TW61693: {'auction_closing_time': 1774884836.0, 'created_time': 1774699245.220006, 'last_price_update_time': 1774873739.140364}
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TW61693') HTTP/1.1" 204 0
2026-03-30 12:28:59 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.nl] INFO: Scrape type for SE95402: 2
2026-03-30 12:28:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402
2026-03-30 12:28:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd7bff2c-839f-53a3-913a-7e1800065f59 with scrape type 2
2026-03-30 12:28:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd7bff2c-839f-53a3-913a-7e1800065f59 with scrape type 2
2026-03-30 12:28:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd7bff2c-839f-53a3-913a-7e1800065f59, identifier: SE95402
2026-03-30 12:28:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402
2026-03-30 12:28:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402
2026-03-30 12:28:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402 to the API
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:58:22Z',
 'fuel_type': 'electro',
 'id': 'cd7bff2c-839f-53a3-913a-7e1800065f59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE95402',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 151881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-22',
 'seller_name': None,
 'title': 'Volkswagen ID.4 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2023}
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.nl] INFO: Saving data for SE95402: {'auction_closing_time': 1774886302.0, 'created_time': 1774699260.527998, 'last_price_update_time': 1774873739.531201}
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE95402') HTTP/1.1" 204 0
2026-03-30 12:28:59 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-30 12:28:59 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-30 12:28:59 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.nl] INFO: Scrape type for RK78214: 2
2026-03-30 12:28:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214
2026-03-30 12:28:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e64196c-af08-5f22-8753-a45314fe44b5 with scrape type 2
2026-03-30 12:28:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e64196c-af08-5f22-8753-a45314fe44b5 with scrape type 2
2026-03-30 12:28:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9e64196c-af08-5f22-8753-a45314fe44b5, identifier: RK78214
2026-03-30 12:28:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214
2026-03-30 12:28:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214
2026-03-30 12:28:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214 to the API
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:39:18Z',
 'fuel_type': 'electro',
 'id': '9e64196c-af08-5f22-8753-a45314fe44b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK78214',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 113999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Life Pro Performance',
 'transmission': 'automatic',
 'trim': 'Life Pro Performance',
 'year': 2021}
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.nl] INFO: Saving data for RK78214: {'auction_closing_time': 1774885158.0, 'created_time': 1774699260.958371, 'last_price_update_time': 1774873740.94602}
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RK78214') HTTP/1.1" 204 0
2026-03-30 12:29:00 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-30 12:29:00 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.nl] INFO: Scrape type for EW45242: 2
2026-03-30 12:29:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242
2026-03-30 12:29:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c08aa1f0-8b82-5feb-a925-af208e6cf76b with scrape type 2
2026-03-30 12:29:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c08aa1f0-8b82-5feb-a925-af208e6cf76b with scrape type 2
2026-03-30 12:29:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c08aa1f0-8b82-5feb-a925-af208e6cf76b, identifier: EW45242
2026-03-30 12:29:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242
2026-03-30 12:29:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242
2026-03-30 12:29:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242 to the API
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:51:16Z',
 'fuel_type': 'petrol',
 'id': 'c08aa1f0-8b82-5feb-a925-af208e6cf76b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW45242',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 274552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-13',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Saving data for EW45242: {'auction_closing_time': 1774885876.0, 'created_time': 1773774238.383516, 'last_price_update_time': 1774873743.660722}
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EW45242') HTTP/1.1" 204 0
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Scrape type for UA80107: 0
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Scrape type for UH76205: 0
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Scrape type for KX92525: 0
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Scrape type for UU92994: 0
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Scrape type for WY17438: 0
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Scrape type for ZS54708: 0
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Scrape type for BB32456: 0
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Scrape type for WW25859: 0
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-30 12:29:03 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.nl] INFO: Scrape type for BP52845: 2
2026-03-30 12:29:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845
2026-03-30 12:29:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with scrape type 2
2026-03-30 12:29:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with scrape type 2
2026-03-30 12:29:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83fb62fd-c291-5280-8113-1b0eaf1e77f4, identifier: BP52845
2026-03-30 12:29:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845
2026-03-30 12:29:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845
2026-03-30 12:29:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845 to the API
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 441,
 'expiration_date': '2026-03-30T15:53:11Z',
 'fuel_type': 'electro',
 'id': '83fb62fd-c291-5280-8113-1b0eaf1e77f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP52845',
 'listing': 'auction',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 184012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seller_name': None,
 'title': 'Tesla Model 3 Long Range Dual AWD AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2019}
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.nl] INFO: Saving data for BP52845: {'auction_closing_time': 1774885991.0, 'created_time': 1774699287.566571, 'last_price_update_time': 1774873744.262472}
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP52845') HTTP/1.1" 204 0
2026-03-30 12:29:04 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.nl] INFO: Scrape type for DX51815: 2
2026-03-30 12:29:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815
2026-03-30 12:29:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99394b93-3aa2-5ad8-b39d-267937e48230 with scrape type 2
2026-03-30 12:29:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99394b93-3aa2-5ad8-b39d-267937e48230 with scrape type 2
2026-03-30 12:29:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99394b93-3aa2-5ad8-b39d-267937e48230, identifier: DX51815
2026-03-30 12:29:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815
2026-03-30 12:29:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815
2026-03-30 12:29:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815 to the API
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:13Z',
 'fuel_type': 'petrol',
 'id': '99394b93-3aa2-5ad8-b39d-267937e48230',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX51815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 235171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 12:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-30 12:29:06 [auto1.nl] INFO: Saving data for DX51815: {'auction_closing_time': 1774885033.0, 'created_time': 1774699277.984793, 'last_price_update_time': 1774873746.421509}
2026-03-30 12:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DX51815') HTTP/1.1" 204 0
2026-03-30 12:29:06 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-30 12:29:06 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-30 12:29:06 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-30 12:29:06 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-30 12:29:06 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-30 12:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-30 12:29:06 [auto1.nl] INFO: Scrape type for NJ12224: 2
2026-03-30 12:29:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224
2026-03-30 12:29:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6225da9c-cd5e-52d7-89f4-e343143e4f34 with scrape type 2
2026-03-30 12:29:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6225da9c-cd5e-52d7-89f4-e343143e4f34 with scrape type 2
2026-03-30 12:29:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6225da9c-cd5e-52d7-89f4-e343143e4f34, identifier: NJ12224
2026-03-30 12:29:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224
2026-03-30 12:29:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224
2026-03-30 12:29:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224 to the API
2026-03-30 12:29:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:47Z',
 'fuel_type': 'diesel',
 'id': '6225da9c-cd5e-52d7-89f4-e343143e4f34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ12224',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 402077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-29',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi Passenger Expression',
 'transmission': 'manual',
 'trim': 'Passenger Expression',
 'year': 2008}
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.nl] INFO: Saving data for NJ12224: {'auction_closing_time': 1774884887.0, 'created_time': 1774699281.644293, 'last_price_update_time': 1774873747.596532}
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ12224') HTTP/1.1" 204 0
2026-03-30 12:29:07 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-30 12:29:07 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.nl] INFO: Scrape type for DJ46393: 2
2026-03-30 12:29:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393
2026-03-30 12:29:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with scrape type 2
2026-03-30 12:29:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with scrape type 2
2026-03-30 12:29:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345, identifier: DJ46393
2026-03-30 12:29:07 [scrapy.extensions.logstats] INFO: Crawled 153 pages (at 5 pages/min), scraped 206 items (at 23 items/min)
2026-03-30 12:29:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:29:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393
2026-03-30 12:29:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393
2026-03-30 12:29:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393 to the API
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:28:42Z',
 'fuel_type': 'petrol',
 'id': '51840e3b-06c3-5d43-a9f2-5efdc8c8c345',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ46393',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 102422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-30 12:29:09 [auto1.nl] INFO: Saving data for DJ46393: {'auction_closing_time': 1774884522.0, 'created_time': 1774699286.145627, 'last_price_update_time': 1774873749.10605}
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DJ46393') HTTP/1.1" 204 0
2026-03-30 12:29:09 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-30 12:29:09 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-30 12:29:09 [auto1.nl] INFO: Scrape type for JF84007: 2
2026-03-30 12:29:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007
2026-03-30 12:29:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a0e11b-1e01-5d26-84aa-8887a06e5405 with scrape type 2
2026-03-30 12:29:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99a0e11b-1e01-5d26-84aa-8887a06e5405 with scrape type 2
2026-03-30 12:29:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99a0e11b-1e01-5d26-84aa-8887a06e5405, identifier: JF84007
2026-03-30 12:29:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007
2026-03-30 12:29:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007
2026-03-30 12:29:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007 to the API
2026-03-30 12:29:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:05:14Z',
 'fuel_type': 'petrol',
 'id': '99a0e11b-1e01-5d26-84aa-8887a06e5405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF84007',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 75581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-28',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Pop',
 'transmission': 'automatic',
 'trim': 'Pop',
 'year': 2015}
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.nl] INFO: Saving data for JF84007: {'auction_closing_time': 1774883114.0, 'created_time': 1774699283.644347, 'last_price_update_time': 1774873750.770556}
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JF84007') HTTP/1.1" 204 0
2026-03-30 12:29:10 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.nl] INFO: Scrape type for KD48941: 2
2026-03-30 12:29:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941
2026-03-30 12:29:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444b097d-a620-589d-bc25-11cf1320e560 with scrape type 2
2026-03-30 12:29:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 444b097d-a620-589d-bc25-11cf1320e560 with scrape type 2
2026-03-30 12:29:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 444b097d-a620-589d-bc25-11cf1320e560, identifier: KD48941
2026-03-30 12:29:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941
2026-03-30 12:29:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941
2026-03-30 12:29:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941 to the API
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:31:18Z',
 'fuel_type': 'petrol',
 'id': '444b097d-a620-589d-bc25-11cf1320e560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD48941',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 71806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-03',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2011}
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.nl] INFO: Saving data for KD48941: {'auction_closing_time': 1774884678.0, 'created_time': 1774699277.292958, 'last_price_update_time': 1774873751.186163}
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KD48941') HTTP/1.1" 204 0
2026-03-30 12:29:11 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.nl] INFO: Scrape type for EU38085: 2
2026-03-30 12:29:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085
2026-03-30 12:29:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f2cef4e-0091-545e-a089-052ef2312c17 with scrape type 2
2026-03-30 12:29:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f2cef4e-0091-545e-a089-052ef2312c17 with scrape type 2
2026-03-30 12:29:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4f2cef4e-0091-545e-a089-052ef2312c17, identifier: EU38085
2026-03-30 12:29:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085
2026-03-30 12:29:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085
2026-03-30 12:29:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085 to the API
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:50:57Z',
 'fuel_type': 'diesel',
 'id': '4f2cef4e-0091-545e-a089-052ef2312c17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU38085',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 272322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 280 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.nl] INFO: Saving data for EU38085: {'auction_closing_time': 1774885857.0, 'created_time': 1774699282.377658, 'last_price_update_time': 1774873751.908527}
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EU38085') HTTP/1.1" 204 0
2026-03-30 12:29:11 [auto1.nl] INFO: Channel: 24h | Page: 26 | totalHits: 1036 | hits on page: 36
2026-03-30 12:29:11 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.nl] INFO: Scrape type for WN94746: 2
2026-03-30 12:29:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746
2026-03-30 12:29:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac72c08-1d0a-5646-915f-155391cbd170 with scrape type 2
2026-03-30 12:29:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ac72c08-1d0a-5646-915f-155391cbd170 with scrape type 2
2026-03-30 12:29:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2ac72c08-1d0a-5646-915f-155391cbd170, identifier: WN94746
2026-03-30 12:29:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746
2026-03-30 12:29:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746
2026-03-30 12:29:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746 to the API
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:21:47Z',
 'fuel_type': 'petrol',
 'id': '2ac72c08-1d0a-5646-915f-155391cbd170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN94746',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 253618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-05',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.nl] INFO: Saving data for WN94746: {'auction_closing_time': 1774884107.0, 'created_time': 1774699283.004934, 'last_price_update_time': 1774873752.362792}
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN94746') HTTP/1.1" 204 0
2026-03-30 12:29:12 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-30 12:29:12 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.nl] INFO: Scrape type for RD76922: 2
2026-03-30 12:29:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922
2026-03-30 12:29:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with scrape type 2
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with scrape type 2
2026-03-30 12:29:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba, identifier: RD76922
2026-03-30 12:29:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:12 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.nl] INFO: Scrape type for WU56616: 2
2026-03-30 12:29:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616
2026-03-30 12:29:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with scrape type 2
2026-03-30 12:29:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with scrape type 2
2026-03-30 12:29:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb, identifier: WU56616
2026-03-30 12:29:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922
2026-03-30 12:29:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922
2026-03-30 12:29:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922 to the API
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:09:22Z',
 'fuel_type': 'petrol',
 'id': 'b187d90e-f2a0-5fe8-9a3d-550b69fae3ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD76922',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 206564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-30 12:29:13 [auto1.nl] INFO: Saving data for RD76922: {'auction_closing_time': 1774883362.0, 'created_time': 1774699263.393796, 'last_price_update_time': 1774873753.502385}
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD76922') HTTP/1.1" 204 0
2026-03-30 12:29:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616
2026-03-30 12:29:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616
2026-03-30 12:29:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616 to the API
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:05:28Z',
 'fuel_type': 'petrol',
 'id': '4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU56616',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 183729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-09',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-30 12:29:13 [auto1.nl] INFO: Saving data for WU56616: {'auction_closing_time': 1774883128.0, 'created_time': 1774699248.980939, 'last_price_update_time': 1774873753.820268}
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WU56616') HTTP/1.1" 204 0
2026-03-30 12:29:13 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-30 12:29:13 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-30 12:29:13 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-30 12:29:13 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-30 12:29:13 [auto1.nl] INFO: Scrape type for WC26387: 2
2026-03-30 12:29:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387
2026-03-30 12:29:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a02d6d4-f622-5010-9d10-9b4d747b9630 with scrape type 2
2026-03-30 12:29:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a02d6d4-f622-5010-9d10-9b4d747b9630 with scrape type 2
2026-03-30 12:29:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a02d6d4-f622-5010-9d10-9b4d747b9630, identifier: WC26387
2026-03-30 12:29:13 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-30 12:29:13 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-30 12:29:13 [auto1.nl] INFO: Scrape type for CT48510: 2
2026-03-30 12:29:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510
2026-03-30 12:29:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92f46fc1-87e1-5d13-bdf2-6214e122592d with scrape type 2
2026-03-30 12:29:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92f46fc1-87e1-5d13-bdf2-6214e122592d with scrape type 2
2026-03-30 12:29:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 92f46fc1-87e1-5d13-bdf2-6214e122592d, identifier: CT48510
2026-03-30 12:29:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387
2026-03-30 12:29:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387
2026-03-30 12:29:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387 to the API
2026-03-30 12:29:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:52:53Z',
 'fuel_type': 'diesel',
 'id': '8a02d6d4-f622-5010-9d10-9b4d747b9630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC26387',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 271792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 113 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2010}
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-30 12:29:15 [auto1.nl] INFO: Saving data for WC26387: {'auction_closing_time': 1774885973.0, 'created_time': 1774008059.084225, 'last_price_update_time': 1774873755.159029}
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC26387') HTTP/1.1" 204 0
2026-03-30 12:29:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510
2026-03-30 12:29:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510
2026-03-30 12:29:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510 to the API
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'petrol',
 'id': '92f46fc1-87e1-5d13-bdf2-6214e122592d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT48510',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 119784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-17',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-30 12:29:15 [auto1.nl] INFO: Saving data for CT48510: {'auction_closing_time': 1774884768.0, 'created_time': 1774699263.004623, 'last_price_update_time': 1774873755.536046}
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT48510') HTTP/1.1" 204 0
2026-03-30 12:29:15 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-30 12:29:15 [auto1.nl] INFO: Scrape type for LF00808: 2
2026-03-30 12:29:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808
2026-03-30 12:29:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64a4567-874e-5e91-8545-53bd59ed3bcf with scrape type 2
2026-03-30 12:29:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a64a4567-874e-5e91-8545-53bd59ed3bcf with scrape type 2
2026-03-30 12:29:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a64a4567-874e-5e91-8545-53bd59ed3bcf, identifier: LF00808
2026-03-30 12:29:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808
2026-03-30 12:29:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808
2026-03-30 12:29:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808 to the API
2026-03-30 12:29:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:03:15Z',
 'fuel_type': 'petrol',
 'id': 'a64a4567-874e-5e91-8545-53bd59ed3bcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF00808',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 173258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-14',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2008}
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-30 12:29:16 [auto1.nl] INFO: Saving data for LF00808: {'auction_closing_time': 1774882995.0, 'created_time': 1774699254.772537, 'last_price_update_time': 1774873756.738396}
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF00808') HTTP/1.1" 204 0
2026-03-30 12:29:16 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-30 12:29:16 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-30 12:29:16 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-30 12:29:16 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-30 12:29:16 [auto1.nl] INFO: Scrape type for JM92964: 2
2026-03-30 12:29:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964
2026-03-30 12:29:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with scrape type 2
2026-03-30 12:29:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with scrape type 2
2026-03-30 12:29:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e, identifier: JM92964
2026-03-30 12:29:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964
2026-03-30 12:29:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964
2026-03-30 12:29:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964 to the API
2026-03-30 12:29:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:32:01Z',
 'fuel_type': 'petrol',
 'id': '73bdbdbb-1e7d-50a7-b51e-883cbdba877e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM92964',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 187016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-17',
 'seller_name': None,
 'title': 'Seat Mii 1.0 FR-Line',
 'transmission': 'manual',
 'trim': 'FR-Line',
 'year': 2017}
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-30 12:29:18 [auto1.nl] INFO: Saving data for JM92964: {'auction_closing_time': 1774884721.0, 'created_time': 1774699258.401759, 'last_price_update_time': 1774873758.188983}
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM92964') HTTP/1.1" 204 0
2026-03-30 12:29:18 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-30 12:29:18 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-30 12:29:18 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-30 12:29:18 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-30 12:29:18 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-30 12:29:18 [auto1.nl] INFO: Scrape type for HJ37238: 2
2026-03-30 12:29:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-30 12:29:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with scrape type 2
2026-03-30 12:29:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with scrape type 2
2026-03-30 12:29:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 473c01f0-6dff-59e4-b78f-b7bd6be80c04, identifier: HJ37238
2026-03-30 12:29:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-30 12:29:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-30 12:29:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238 to the API
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:54:27Z',
 'fuel_type': 'diesel',
 'id': '473c01f0-6dff-59e4-b78f-b7bd6be80c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ37238',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 229510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Compact Basis',
 'transmission': 'manual',
 'trim': 'Rapid Compact Basis',
 'year': 2019}
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-30 12:29:18 [auto1.nl] INFO: Saving data for HJ37238: {'auction_closing_time': 1774886067.0, 'created_time': 1774002028.690083, 'last_price_update_time': 1774873758.592218}
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HJ37238') HTTP/1.1" 204 0
2026-03-30 12:29:18 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-30 12:29:18 [auto1.nl] INFO: Scrape type for JK34334: 2
2026-03-30 12:29:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334
2026-03-30 12:29:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413cc031-18a1-59e6-a153-6656c2207504 with scrape type 2
2026-03-30 12:29:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 413cc031-18a1-59e6-a153-6656c2207504 with scrape type 2
2026-03-30 12:29:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 413cc031-18a1-59e6-a153-6656c2207504, identifier: JK34334
2026-03-30 12:29:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334
2026-03-30 12:29:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334
2026-03-30 12:29:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334 to the API
2026-03-30 12:29:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:23:00Z',
 'fuel_type': 'petrol',
 'id': '413cc031-18a1-59e6-a153-6656c2207504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK34334',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 182947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-24',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-30 12:29:19 [auto1.nl] INFO: Saving data for JK34334: {'auction_closing_time': 1774884180.0, 'created_time': 1774699257.77111, 'last_price_update_time': 1774873759.89582}
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK34334') HTTP/1.1" 204 0
2026-03-30 12:29:20 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-30 12:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-30 12:29:20 [auto1.nl] INFO: Scrape type for YB88576: 2
2026-03-30 12:29:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576
2026-03-30 12:29:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with scrape type 2
2026-03-30 12:29:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with scrape type 2
2026-03-30 12:29:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e, identifier: YB88576
2026-03-30 12:29:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576
2026-03-30 12:29:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576
2026-03-30 12:29:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576 to the API
2026-03-30 12:29:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:13:27Z',
 'fuel_type': 'diesel',
 'id': 'd2d8fe64-2e0f-5774-af0e-e5b13e499b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB88576',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 143378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-24',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'automatic',
 'trim': 'Club M',
 'year': 2021}
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Saving data for YB88576: {'auction_closing_time': 1774883607.0, 'created_time': 1774699259.267465, 'last_price_update_time': 1774873761.399792}
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB88576') HTTP/1.1" 204 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for YG37971: 2
2026-03-30 12:29:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971
2026-03-30 12:29:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cacd395-a1ad-5602-87f2-8ffb1476e019 with scrape type 2
2026-03-30 12:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cacd395-a1ad-5602-87f2-8ffb1476e019 with scrape type 2
2026-03-30 12:29:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4cacd395-a1ad-5602-87f2-8ffb1476e019, identifier: YG37971
2026-03-30 12:29:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971
2026-03-30 12:29:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971
2026-03-30 12:29:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971 to the API
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:57:09Z',
 'fuel_type': 'petrol',
 'id': '4cacd395-a1ad-5602-87f2-8ffb1476e019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG37971',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 343295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-20',
 'seller_name': None,
 'title': 'Ford Mondeo 2.3 Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Saving data for YG37971: {'auction_closing_time': 1774886229.0, 'created_time': 1774699252.077458, 'last_price_update_time': 1774873761.830427}
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YG37971') HTTP/1.1" 204 0
2026-03-30 12:29:21 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.nl] INFO: Scrape type for UF88780: 2
2026-03-30 12:29:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780
2026-03-30 12:29:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08939ddd-895c-578d-a6d4-0334c2d14419 with scrape type 2
2026-03-30 12:29:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08939ddd-895c-578d-a6d4-0334c2d14419 with scrape type 2
2026-03-30 12:29:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 08939ddd-895c-578d-a6d4-0334c2d14419, identifier: UF88780
2026-03-30 12:29:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780
2026-03-30 12:29:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780
2026-03-30 12:29:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780 to the API
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:44:30Z',
 'fuel_type': 'hybrid',
 'id': '08939ddd-895c-578d-a6d4-0334c2d14419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF88780',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 60311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Smart 2WD',
 'transmission': 'automatic',
 'trim': 'Smart 2WD',
 'year': 2021}
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.nl] INFO: Saving data for UF88780: {'auction_closing_time': 1774885470.0, 'created_time': 1774699261.697784, 'last_price_update_time': 1774873762.221257}
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF88780') HTTP/1.1" 204 0
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.nl] INFO: Scrape type for KC88699: 2
2026-03-30 12:29:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699
2026-03-30 12:29:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b24f0d-13c4-59a9-9eef-98f364879240 with scrape type 2
2026-03-30 12:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2b24f0d-13c4-59a9-9eef-98f364879240 with scrape type 2
2026-03-30 12:29:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e2b24f0d-13c4-59a9-9eef-98f364879240, identifier: KC88699
2026-03-30 12:29:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699
2026-03-30 12:29:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699
2026-03-30 12:29:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699 to the API
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:50:50Z',
 'fuel_type': 'petrol',
 'id': 'e2b24f0d-13c4-59a9-9eef-98f364879240',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC88699',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 185215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-01',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2006}
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.nl] INFO: Saving data for KC88699: {'auction_closing_time': 1774885850.0, 'created_time': 1774699257.31802, 'last_price_update_time': 1774873762.653487}
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC88699') HTTP/1.1" 204 0
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-30 12:29:22 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-30 12:29:22 [auto1.nl] INFO: Scrape type for WZ79997: 2
2026-03-30 12:29:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997
2026-03-30 12:29:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with scrape type 2
2026-03-30 12:29:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with scrape type 2
2026-03-30 12:29:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67, identifier: WZ79997
2026-03-30 12:29:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997
2026-03-30 12:29:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997
2026-03-30 12:29:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997 to the API
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:29:27Z',
 'fuel_type': 'petrol',
 'id': '5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ79997',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 131843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-06',
 'seller_name': None,
 'title': 'BMW Z4 sDrive 35is',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.nl] INFO: Saving data for WZ79997: {'auction_closing_time': 1774884567.0, 'created_time': 1774699281.997488, 'last_price_update_time': 1774873763.105421}
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ79997') HTTP/1.1" 204 0
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.nl] INFO: Scrape type for MP39959: 0
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.nl] INFO: Scrape type for YN95467: 2
2026-03-30 12:29:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467
2026-03-30 12:29:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b806ca-e617-5017-9a8f-cf159d2a0074 with scrape type 2
2026-03-30 12:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23b806ca-e617-5017-9a8f-cf159d2a0074 with scrape type 2
2026-03-30 12:29:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 23b806ca-e617-5017-9a8f-cf159d2a0074, identifier: YN95467
2026-03-30 12:29:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467
2026-03-30 12:29:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467
2026-03-30 12:29:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467 to the API
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:11:45Z',
 'fuel_type': 'petrol',
 'id': '23b806ca-e617-5017-9a8f-cf159d2a0074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN95467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 339212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-02',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.nl] INFO: Saving data for YN95467: {'auction_closing_time': 1774883505.0, 'created_time': 1773343671.482367, 'last_price_update_time': 1774873763.544892}
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YN95467') HTTP/1.1" 204 0
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-30 12:29:23 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-30 12:29:23 [auto1.nl] INFO: Scrape type for AW17903: 2
2026-03-30 12:29:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903
2026-03-30 12:29:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e7d487d-b708-5833-a488-56123a041330 with scrape type 2
2026-03-30 12:29:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e7d487d-b708-5833-a488-56123a041330 with scrape type 2
2026-03-30 12:29:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e7d487d-b708-5833-a488-56123a041330, identifier: AW17903
2026-03-30 12:29:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903
2026-03-30 12:29:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903
2026-03-30 12:29:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903 to the API
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:05:39Z',
 'fuel_type': 'petrol',
 'id': '2e7d487d-b708-5833-a488-56123a041330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW17903',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 91578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-21',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-30 12:29:24 [auto1.nl] INFO: Saving data for AW17903: {'auction_closing_time': 1774883139.0, 'created_time': 1774699276.004827, 'last_price_update_time': 1774873764.043425}
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW17903') HTTP/1.1" 204 0
2026-03-30 12:29:24 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-30 12:29:24 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-30 12:29:24 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-30 12:29:24 [auto1.nl] INFO: Scrape type for NC22018: 2
2026-03-30 12:29:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018
2026-03-30 12:29:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 992869ee-8e19-5896-bff5-5f5d685d7384 with scrape type 2
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 992869ee-8e19-5896-bff5-5f5d685d7384 with scrape type 2
2026-03-30 12:29:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 992869ee-8e19-5896-bff5-5f5d685d7384, identifier: NC22018
2026-03-30 12:29:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018
2026-03-30 12:29:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018
2026-03-30 12:29:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018 to the API
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:52:24Z',
 'fuel_type': 'petrol',
 'id': '992869ee-8e19-5896-bff5-5f5d685d7384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC22018',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 58238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-20',
 'seller_name': None,
 'title': 'MINI Cooper 60 Years',
 'transmission': 'automatic',
 'trim': '60 Years',
 'year': 2020}
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-30 12:29:24 [auto1.nl] INFO: Saving data for NC22018: {'auction_closing_time': 1774885944.0, 'created_time': 1773343175.476087, 'last_price_update_time': 1774873764.489641}
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NC22018') HTTP/1.1" 204 0
2026-03-30 12:29:24 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-30 12:29:24 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-30 12:29:24 [auto1.nl] INFO: Scrape type for ZG49112: 2
2026-03-30 12:29:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112
2026-03-30 12:29:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cfef7af-d3d7-5803-87eb-e023b45625af with scrape type 2
2026-03-30 12:29:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cfef7af-d3d7-5803-87eb-e023b45625af with scrape type 2
2026-03-30 12:29:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7cfef7af-d3d7-5803-87eb-e023b45625af, identifier: ZG49112
2026-03-30 12:29:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112
2026-03-30 12:29:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112
2026-03-30 12:29:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112 to the API
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:54:15Z',
 'fuel_type': 'petrol',
 'id': '7cfef7af-d3d7-5803-87eb-e023b45625af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG49112',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 85608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-23',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-30 12:29:24 [auto1.nl] INFO: Saving data for ZG49112: {'auction_closing_time': 1774886055.0, 'created_time': 1774699279.708487, 'last_price_update_time': 1774873764.926338}
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG49112') HTTP/1.1" 204 0
2026-03-30 12:30:07 [scrapy.extensions.logstats] INFO: Crawled 154 pages (at 1 pages/min), scraped 228 items (at 22 items/min)
2026-03-30 12:30:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 12:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:24 [auto1.nl] INFO: Channel: 24h | Page: 27 | totalHits: 1035 | hits on page: 0
2026-03-30 12:30:24 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 12:30:24 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-30 12:30:24 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 3, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 4}
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774441824 HTTP/1.1" 200 None
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB93452') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AD54861') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AF24468') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AH28255') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AV93319') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AY01559') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AZ18221') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BG49593') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP69352') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BX63844') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CZ61189') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK09844') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR42306') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DT22338') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DY24013') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG60250') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FW03371') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FX73873') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GS03966') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HF03850') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HH05172') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HH88629') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HM34927') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HM64059') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT74962') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JD71985') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JP53443') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LW01183') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LX39240') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW58977') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NA85148') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NB46773') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NN28478') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NP49029') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NS69992') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NW94939') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PF68501') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PG73038') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PJ67365') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PT19677') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC75140') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD75531') HTTP/1.1" 204 0
2026-03-30 12:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RH46588') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RR83701') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RS42544') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT66146') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SG77147') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY97110') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TL86004') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TW41628') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD34406') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH35319') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VK26199') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VK37076') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WJ68160') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN19961') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN85453') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS88361') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XB79277') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XM44232') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW27566') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY81555') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YD99186') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YL35850') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZH96401') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZJ39483') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZK39439') HTTP/1.1" 204 0
2026-03-30 12:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZZ12005') HTTP/1.1" 204 0
2026-03-30 12:30:25 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (228 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-30T12_00_00.jl
2026-03-30 12:30:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 782265,
 'downloader/request_count': 433,
 'downloader/request_method_count/GET': 404,
 'downloader/request_method_count/POST': 29,
 'downloader/response_bytes': 179838197,
 'downloader/response_count': 433,
 'downloader/response_status_count/200': 433,
 'dupefilter/filtered': 17,
 'elapsed_time_seconds': 1817.920957,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 12, 30, 25, 342638, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 228,
 'log_count/DEBUG': 5789,
 'log_count/INFO': 5845,
 'memusage/max': 203849728,
 'memusage/startup': 147820544,
 'photo_download_count': 278,
 'request_depth_max': 30,
 'response_received_count': 155,
 'scheduler/dequeued': 433,
 'scheduler/dequeued/memory': 433,
 'scheduler/enqueued': 433,
 'scheduler/enqueued/memory': 433,
 'scrape_type/batch_skipped': 522,
 'scrape_type/new': 62,
 'scrape_type/price_update': 166,
 'scrape_type/skipped': 309,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 201,
 'scrapy-zyte-api/error_ratio': 0.22885572139303484,
 'scrapy-zyte-api/errors': 46,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 46,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 13.495001369492423,
 'scrapy-zyte-api/mean_response_seconds': 13.525060711870152,
 'scrapy-zyte-api/processed': 155,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 155,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 154,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 155,
 'scrapy-zyte-api/request_args/httpRequestBody': 29,
 'scrapy-zyte-api/request_args/httpRequestMethod': 29,
 'scrapy-zyte-api/request_args/httpResponseBody': 155,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 155,
 'scrapy-zyte-api/request_args/sessionContext': 155,
 'scrapy-zyte-api/request_args/url': 155,
 'scrapy-zyte-api/status_codes/0': 46,
 'scrapy-zyte-api/status_codes/200': 155,
 'scrapy-zyte-api/success': 155,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1076,
 'source/total_available': 1035,
 'start_time': datetime.datetime(2026, 3, 30, 12, 0, 7, 421681, tzinfo=datetime.timezone.utc)}
2026-03-30 12:30:25 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 12:30:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9b75682750>
2026-03-30 12:30:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9b75682b10>