2026-03-20 10:18:31 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-20 10:18:31 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-20 10:18:31 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-20 10:18:31 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-20 10:18:31 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-20 10:18:31 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-20 10:18:31 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-20 10:18:31 [scrapy.extensions.telnet] INFO: Telnet Password: d94a5e74b6d7c137
2026-03-20 10:18:31 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-20 10:18:31 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/2026-03-20T10_18_27.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-20 10:18:32 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-20 10:18:32 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-20 10:18:32 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-20 10:18:32 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-20 10:18:32 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-20 10:18:32 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-20 10:18:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-20 10:18:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-20 10:18:32 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-20 10:18:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-20 10:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:18:32 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-20 10:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-20 10:18:32 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-20 10:18:32 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-20 10:18:32 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-20 10:18:32 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-20 10:18:32 [scrapy.core.engine] INFO: Spider opened
2026-03-20 10:18:32 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-20 10:18:32 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-20 10:18:32 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-20 10:18:32 [scrapy-playwright] INFO: Starting download handler
2026-03-20 10:18:32 [scrapy-playwright] INFO: Starting download handler
2026-03-20 10:18:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-20 10:18:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-20 10:18:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-20 10:19:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-20 10:19:11 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 1055 | hits on page: 40
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for LD78562: 1
2026-03-20 10:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: DK51587
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK51587%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for DK51587: 1
2026-03-20 10:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: JB59132
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB59132%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for JB59132: 1
2026-03-20 10:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: RC52730
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC52730%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for RC52730: 1
2026-03-20 10:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for JH24547: 1
2026-03-20 10:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: HT83355
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT83355%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for HT83355: 1
2026-03-20 10:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: JF06657
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF06657%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for JF06657: 1
2026-03-20 10:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: UJ12956
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ12956%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for UJ12956: 1
2026-03-20 10:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: NV81298
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV81298%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for NV81298: 1
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for FE12544: 0
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU03556%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for CU03556: 0
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: SC55043
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SC55043%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for SC55043: 1
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: GX17086
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX17086%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for GX17086: 1
2026-03-20 10:19:11 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE53949%27 HTTP/1.1" 200 None
2026-03-20 10:19:11 [auto1.nl] INFO: Scrape type for CE53949: 2
2026-03-20 10:19:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb42cb56-3e90-5069-969d-3a19f0d2cd7d with identifier: CE53949
2026-03-20 10:19:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb42cb56-3e90-5069-969d-3a19f0d2cd7d with scrape type 2
2026-03-20 10:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb42cb56-3e90-5069-969d-3a19f0d2cd7d with scrape type 2
2026-03-20 10:19:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eb42cb56-3e90-5069-969d-3a19f0d2cd7d, identifier: CE53949
2026-03-20 10:19:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eb42cb56-3e90-5069-969d-3a19f0d2cd7d with identifier: CE53949
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-20 10:19:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-20 10:19:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eb42cb56-3e90-5069-969d-3a19f0d2cd7d with identifier: CE53949
2026-03-20 10:19:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eb42cb56-3e90-5069-969d-3a19f0d2cd7d with identifier: CE53949 to the API
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-21T16:52:11Z',
 'fuel_type': 'petrol',
 'id': 'eb42cb56-3e90-5069-969d-3a19f0d2cd7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE53949',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 149803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-21',
 'seller_name': None,
 'title': 'Nissan Juke 1.2 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2016}
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE53949%27 HTTP/1.1" 200 None
2026-03-20 10:19:12 [auto1.nl] INFO: Saving data for CE53949: {'auction_closing_time': 1774111931.0, 'created_time': 1773688435.291099, 'last_price_update_time': 1774001952.73461}
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CE53949') HTTP/1.1" 204 0
2026-03-20 10:19:12 [auto1.nl] INFO: Found listing with ID: MT74092
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT74092%27 HTTP/1.1" 200 None
2026-03-20 10:19:12 [auto1.nl] INFO: Scrape type for MT74092: 1
2026-03-20 10:19:12 [auto1.nl] INFO: Found listing with ID: TL68396
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL68396%27 HTTP/1.1" 200 None
2026-03-20 10:19:12 [auto1.nl] INFO: Scrape type for TL68396: 1
2026-03-20 10:19:12 [auto1.nl] INFO: Found listing with ID: BL87851
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL87851%27 HTTP/1.1" 200 None
2026-03-20 10:19:12 [auto1.nl] INFO: Scrape type for BL87851: 2
2026-03-20 10:19:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2774849b-5924-57ed-bb64-bad069454609 with identifier: BL87851
2026-03-20 10:19:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2774849b-5924-57ed-bb64-bad069454609 with scrape type 2
2026-03-20 10:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2774849b-5924-57ed-bb64-bad069454609 with scrape type 2
2026-03-20 10:19:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2774849b-5924-57ed-bb64-bad069454609, identifier: BL87851
2026-03-20 10:19:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2774849b-5924-57ed-bb64-bad069454609 with identifier: BL87851
2026-03-20 10:19:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2774849b-5924-57ed-bb64-bad069454609 with identifier: BL87851
2026-03-20 10:19:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2774849b-5924-57ed-bb64-bad069454609 with identifier: BL87851 to the API
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-21T16:24:05Z',
 'fuel_type': 'petrol',
 'id': '2774849b-5924-57ed-bb64-bad069454609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL87851',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 120775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-27',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL87851%27 HTTP/1.1" 200 None
2026-03-20 10:19:13 [auto1.nl] INFO: Saving data for BL87851: {'auction_closing_time': 1774110245.0, 'created_time': 1773135287.965782, 'last_price_update_time': 1774001953.464971}
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BL87851') HTTP/1.1" 204 0
2026-03-20 10:19:13 [auto1.nl] INFO: Found listing with ID: YZ65934
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ65934%27 HTTP/1.1" 200 None
2026-03-20 10:19:13 [auto1.nl] INFO: Scrape type for YZ65934: 1
2026-03-20 10:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC52730/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB59132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:13 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW20864%27 HTTP/1.1" 200 None
2026-03-20 10:19:13 [auto1.nl] INFO: Scrape type for JW20864: 1
2026-03-20 10:19:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD78562/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH24547/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:13 [auto1.nl] INFO: Found listing with ID: EM54689
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54689%27 HTTP/1.1" 200 None
2026-03-20 10:19:13 [auto1.nl] INFO: Scrape type for EM54689: 1
2026-03-20 10:19:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:13 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-20 10:19:13 [auto1.nl] INFO: Scrape type for HX69861: 1
2026-03-20 10:19:13 [auto1.nl] INFO: Found listing with ID: TC74533
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC74533%27 HTTP/1.1" 200 None
2026-03-20 10:19:13 [auto1.nl] INFO: Scrape type for TC74533: 1
2026-03-20 10:19:13 [auto1.nl] INFO: Found listing with ID: VY67313
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY67313%27 HTTP/1.1" 200 None
2026-03-20 10:19:13 [auto1.nl] INFO: Scrape type for VY67313: 2
2026-03-20 10:19:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 443fce47-22a6-5803-ac0c-b252103c2629 with identifier: VY67313
2026-03-20 10:19:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 443fce47-22a6-5803-ac0c-b252103c2629 with scrape type 2
2026-03-20 10:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 443fce47-22a6-5803-ac0c-b252103c2629 with scrape type 2
2026-03-20 10:19:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 443fce47-22a6-5803-ac0c-b252103c2629, identifier: VY67313
2026-03-20 10:19:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 443fce47-22a6-5803-ac0c-b252103c2629 with identifier: VY67313
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-20 10:19:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 443fce47-22a6-5803-ac0c-b252103c2629 with identifier: VY67313
2026-03-20 10:19:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 443fce47-22a6-5803-ac0c-b252103c2629 with identifier: VY67313 to the API
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-21T16:09:46Z',
 'fuel_type': 'hybrid',
 'id': '443fce47-22a6-5803-ac0c-b252103c2629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY67313',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 48392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-31',
 'seller_name': None,
 'title': 'BMW 3er 330e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY67313%27 HTTP/1.1" 200 None
2026-03-20 10:19:14 [auto1.nl] INFO: Saving data for VY67313: {'auction_closing_time': 1774109386.0, 'created_time': 1773774973.083636, 'last_price_update_time': 1774001954.515591}
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VY67313') HTTP/1.1" 204 0
2026-03-20 10:19:14 [auto1.nl] INFO: Found listing with ID: KE35352
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE35352%27 HTTP/1.1" 200 None
2026-03-20 10:19:14 [auto1.nl] INFO: Scrape type for KE35352: 2
2026-03-20 10:19:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb57bc4f-4d61-5313-b399-18f6127ff188 with identifier: KE35352
2026-03-20 10:19:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb57bc4f-4d61-5313-b399-18f6127ff188 with scrape type 2
2026-03-20 10:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb57bc4f-4d61-5313-b399-18f6127ff188 with scrape type 2
2026-03-20 10:19:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cb57bc4f-4d61-5313-b399-18f6127ff188, identifier: KE35352
2026-03-20 10:19:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cb57bc4f-4d61-5313-b399-18f6127ff188 with identifier: KE35352
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-20 10:19:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cb57bc4f-4d61-5313-b399-18f6127ff188 with identifier: KE35352
2026-03-20 10:19:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cb57bc4f-4d61-5313-b399-18f6127ff188 with identifier: KE35352 to the API
2026-03-20 10:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-21T16:46:05Z',
 'fuel_type': 'petrol',
 'id': 'cb57bc4f-4d61-5313-b399-18f6127ff188',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE35352',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 65258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-12',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2023}
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE35352%27 HTTP/1.1" 200 None
2026-03-20 10:19:15 [auto1.nl] INFO: Saving data for KE35352: {'auction_closing_time': 1774111565.0, 'created_time': 1773775137.100274, 'last_price_update_time': 1774001955.306099}
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KE35352') HTTP/1.1" 204 0
2026-03-20 10:19:15 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 1055 | hits on page: 40
2026-03-20 10:19:15 [auto1.nl] INFO: Found listing with ID: VJ98310
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ98310%27 HTTP/1.1" 200 None
2026-03-20 10:19:15 [auto1.nl] INFO: Scrape type for VJ98310: 2
2026-03-20 10:19:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc90212-a5ee-5cc6-bea4-cfe2014f9c26 with identifier: VJ98310
2026-03-20 10:19:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc90212-a5ee-5cc6-bea4-cfe2014f9c26 with scrape type 2
2026-03-20 10:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc90212-a5ee-5cc6-bea4-cfe2014f9c26 with scrape type 2
2026-03-20 10:19:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4dc90212-a5ee-5cc6-bea4-cfe2014f9c26, identifier: VJ98310
2026-03-20 10:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT83355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF06657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK51587/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4dc90212-a5ee-5cc6-bea4-cfe2014f9c26 with identifier: VJ98310
2026-03-20 10:19:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4dc90212-a5ee-5cc6-bea4-cfe2014f9c26 with identifier: VJ98310
2026-03-20 10:19:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4dc90212-a5ee-5cc6-bea4-cfe2014f9c26 with identifier: VJ98310 to the API
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-21T16:27:38Z',
 'fuel_type': 'hybrid',
 'id': '4dc90212-a5ee-5cc6-bea4-cfe2014f9c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ98310',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 89468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-20',
 'seller_name': None,
 'title': 'Volvo V90 2.0 T8 Plug-in Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2020}
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ98310%27 HTTP/1.1" 200 None
2026-03-20 10:19:15 [auto1.nl] INFO: Saving data for VJ98310: {'auction_closing_time': 1774110458.0, 'created_time': 1773775245.482312, 'last_price_update_time': 1774001955.817622}
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VJ98310') HTTP/1.1" 204 0
2026-03-20 10:19:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:15 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-20 10:19:15 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV51543%27 HTTP/1.1" 200 None
2026-03-20 10:19:15 [auto1.nl] INFO: Scrape type for UV51543: 1
2026-03-20 10:19:15 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/LD78562/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-20 10:19:15 [auto1.nl] INFO: Found listing with ID: DK51587
2026-03-20 10:19:15 [auto1.nl] INFO: Found listing with ID: EF13985
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF13985%27 HTTP/1.1" 200 None
2026-03-20 10:19:15 [auto1.nl] INFO: Scrape type for EF13985: 1
2026-03-20 10:19:15 [auto1.nl] INFO: Found listing with ID: JB59132
2026-03-20 10:19:15 [auto1.nl] INFO: Found listing with ID: AD85278
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD85278%27 HTTP/1.1" 200 None
2026-03-20 10:19:16 [auto1.nl] INFO: Scrape type for AD85278: 1
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: RC52730
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP30662%27 HTTP/1.1" 200 None
2026-03-20 10:19:16 [auto1.nl] INFO: Scrape type for HP30662: 0
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: CV57323
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV57323%27 HTTP/1.1" 200 None
2026-03-20 10:19:16 [auto1.nl] INFO: Scrape type for CV57323: 1
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: KR30932
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR30932%27 HTTP/1.1" 200 None
2026-03-20 10:19:16 [auto1.nl] INFO: Scrape type for KR30932: 1
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: HT83355
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: HA77445
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA77445%27 HTTP/1.1" 200 None
2026-03-20 10:19:16 [auto1.nl] INFO: Scrape type for HA77445: 1
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: JF06657
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: CY89848
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY89848%27 HTTP/1.1" 200 None
2026-03-20 10:19:16 [auto1.nl] INFO: Scrape type for CY89848: 0
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-20 10:19:16 [auto1.nl] INFO: Scrape type for GK27630: 2
2026-03-20 10:19:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630
2026-03-20 10:19:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deac8add-ab2e-5633-9caf-542ff677dfb3 with scrape type 2
2026-03-20 10:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deac8add-ab2e-5633-9caf-542ff677dfb3 with scrape type 2
2026-03-20 10:19:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: deac8add-ab2e-5633-9caf-542ff677dfb3, identifier: GK27630
2026-03-20 10:19:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630
2026-03-20 10:19:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630
2026-03-20 10:19:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: deac8add-ab2e-5633-9caf-542ff677dfb3 with identifier: GK27630 to the API
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-21T16:18:32Z',
 'fuel_type': 'petrol',
 'id': 'deac8add-ab2e-5633-9caf-542ff677dfb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK27630',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 25900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2022}
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-20 10:19:16 [auto1.nl] INFO: Saving data for GK27630: {'auction_closing_time': 1774109912.0, 'created_time': 1773688530.587234, 'last_price_update_time': 1774001956.761026}
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GK27630') HTTP/1.1" 204 0
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: UJ12956
2026-03-20 10:19:16 [auto1.nl] INFO: Found listing with ID: SE25679
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE25679%27 HTTP/1.1" 200 None
2026-03-20 10:19:16 [auto1.nl] INFO: Scrape type for SE25679: 2
2026-03-20 10:19:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593ce6cf-71e7-5d89-a9a1-9f69b4994a3b with identifier: SE25679
2026-03-20 10:19:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593ce6cf-71e7-5d89-a9a1-9f69b4994a3b with scrape type 2
2026-03-20 10:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 593ce6cf-71e7-5d89-a9a1-9f69b4994a3b with scrape type 2
2026-03-20 10:19:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 593ce6cf-71e7-5d89-a9a1-9f69b4994a3b, identifier: SE25679
2026-03-20 10:19:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 593ce6cf-71e7-5d89-a9a1-9f69b4994a3b with identifier: SE25679
2026-03-20 10:19:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 593ce6cf-71e7-5d89-a9a1-9f69b4994a3b with identifier: SE25679
2026-03-20 10:19:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 593ce6cf-71e7-5d89-a9a1-9f69b4994a3b with identifier: SE25679 to the API
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-21T16:08:11Z',
 'fuel_type': 'petrol',
 'id': '593ce6cf-71e7-5d89-a9a1-9f69b4994a3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE25679',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 13919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2023}
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE25679%27 HTTP/1.1" 200 None
2026-03-20 10:19:17 [auto1.nl] INFO: Saving data for SE25679: {'auction_closing_time': 1774109291.0, 'created_time': 1773688526.388197, 'last_price_update_time': 1774001957.25445}
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE25679') HTTP/1.1" 204 0
2026-03-20 10:19:17 [auto1.nl] INFO: Found listing with ID: NV81298
2026-03-20 10:19:17 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-20 10:19:17 [auto1.nl] INFO: Scrape type for VW91946: 2
2026-03-20 10:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946
2026-03-20 10:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c34f38d-62c3-5f02-a8b4-02aed503c9da with scrape type 2
2026-03-20 10:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c34f38d-62c3-5f02-a8b4-02aed503c9da with scrape type 2
2026-03-20 10:19:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5c34f38d-62c3-5f02-a8b4-02aed503c9da, identifier: VW91946
2026-03-20 10:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV81298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ12956/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT74092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX17086/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC55043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-20 10:19:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946
2026-03-20 10:19:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946 to the API
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-21T16:42:57Z',
 'fuel_type': 'petrol',
 'id': '5c34f38d-62c3-5f02-a8b4-02aed503c9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW91946',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 48295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.4 TCe Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2011}
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-20 10:19:17 [auto1.nl] INFO: Saving data for VW91946: {'auction_closing_time': 1774111377.0, 'created_time': 1773687674.659382, 'last_price_update_time': 1774001957.870228}
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VW91946') HTTP/1.1" 204 0
2026-03-20 10:19:17 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-20 10:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-20 10:19:18 [auto1.nl] INFO: Scrape type for FE12544: 0
2026-03-20 10:19:18 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU03556%27 HTTP/1.1" 200 None
2026-03-20 10:19:18 [auto1.nl] INFO: Scrape type for CU03556: 0
2026-03-20 10:19:18 [auto1.nl] INFO: Found listing with ID: SC55043
2026-03-20 10:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:18 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-20 10:19:18 [auto1.nl] INFO: Scrape type for XA55617: 0
2026-03-20 10:19:18 [auto1.nl] INFO: Found listing with ID: TN28630
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN28630%27 HTTP/1.1" 200 None
2026-03-20 10:19:18 [auto1.nl] INFO: Scrape type for TN28630: 2
2026-03-20 10:19:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e6a49c-0876-5391-bca7-c5e34543c37f with identifier: TN28630
2026-03-20 10:19:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e6a49c-0876-5391-bca7-c5e34543c37f with scrape type 2
2026-03-20 10:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e6a49c-0876-5391-bca7-c5e34543c37f with scrape type 2
2026-03-20 10:19:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e2e6a49c-0876-5391-bca7-c5e34543c37f, identifier: TN28630
2026-03-20 10:19:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e2e6a49c-0876-5391-bca7-c5e34543c37f with identifier: TN28630
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-20 10:19:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e2e6a49c-0876-5391-bca7-c5e34543c37f with identifier: TN28630
2026-03-20 10:19:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e2e6a49c-0876-5391-bca7-c5e34543c37f with identifier: TN28630 to the API
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-21T16:43:31Z',
 'fuel_type': 'petrol',
 'id': 'e2e6a49c-0876-5391-bca7-c5e34543c37f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN28630',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 64012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-10',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 TCe Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN28630%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Saving data for TN28630: {'auction_closing_time': 1774111411.0, 'created_time': 1773688205.397898, 'last_price_update_time': 1774001959.031577}
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN28630') HTTP/1.1" 204 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: GX17086
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY63395%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for ZY63395: 2
2026-03-20 10:19:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e399b4a-c341-597c-ac0d-544407c5961d with identifier: ZY63395
2026-03-20 10:19:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e399b4a-c341-597c-ac0d-544407c5961d with scrape type 2
2026-03-20 10:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e399b4a-c341-597c-ac0d-544407c5961d with scrape type 2
2026-03-20 10:19:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e399b4a-c341-597c-ac0d-544407c5961d, identifier: ZY63395
2026-03-20 10:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW20864/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ65934/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL68396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e399b4a-c341-597c-ac0d-544407c5961d with identifier: ZY63395
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-20 10:19:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e399b4a-c341-597c-ac0d-544407c5961d with identifier: ZY63395
2026-03-20 10:19:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e399b4a-c341-597c-ac0d-544407c5961d with identifier: ZY63395 to the API
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-21T16:32:05Z',
 'fuel_type': 'diesel',
 'id': '1e399b4a-c341-597c-ac0d-544407c5961d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY63395',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 198675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-11',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D3 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2018}
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY63395%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Saving data for ZY63395: {'auction_closing_time': 1774110725.0, 'created_time': 1773687702.194732, 'last_price_update_time': 1774001959.661484}
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZY63395') HTTP/1.1" 204 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE53949%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for CE53949: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: MT74092
2026-03-20 10:19:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for YF67230: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: TL68396
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: BL87851
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL87851%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for BL87851: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: YZ65934
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: EM54689
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: TC74533
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: VY67313
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY67313%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for VY67313: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: KE35352
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE35352%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for KE35352: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: VJ98310
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ98310%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for VJ98310: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: EF13985
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: AD85278
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP30662%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for HP30662: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: CV57323
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: KR30932
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: HA77445
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: CY89848
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY89848%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for CY89848: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for GK27630: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: SE25679
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE25679%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for SE25679: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for VW91946: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-20 10:19:19 [auto1.nl] INFO: Scrape type for XA55617: 0
2026-03-20 10:19:19 [auto1.nl] INFO: Found listing with ID: TN28630
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN28630%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [auto1.nl] INFO: Scrape type for TN28630: 0
2026-03-20 10:19:20 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY63395%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [auto1.nl] INFO: Scrape type for ZY63395: 0
2026-03-20 10:19:20 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [auto1.nl] INFO: Scrape type for YF67230: 0
2026-03-20 10:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH24547> (referer: https://www.auto1.com/v1/car-details-view/JH24547/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547
2026-03-20 10:19:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64fcd272-55ff-5554-82d7-a83a99840a93 with scrape type 1
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_b77eb0fbbbe23c45ff6f04a5333ee87d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_b77eb0fbbbe23c45ff6f04a5333ee87d.jpg not downloaded yet
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_f0e6f3b8e9590375dace3745b62d8941.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_f0e6f3b8e9590375dace3745b62d8941.jpg not downloaded yet
2026-03-20 10:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM54689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_efa473a86a342d1319740c6e07f2865c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_efa473a86a342d1319740c6e07f2865c.jpg not downloaded yet
2026-03-20 10:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_4315d653f57fdf54e53f914edf330a1e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_4315d653f57fdf54e53f914edf330a1e.jpg not downloaded yet
2026-03-20 10:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD78562> (referer: https://www.auto1.com/v1/car-details-view/LD78562/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC74533/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_57c856dd6ca266c71de6ea0be0723a13.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_57c856dd6ca266c71de6ea0be0723a13.jpg not downloaded yet
2026-03-20 10:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_33cb476184c8e2fd1423edcf0d38cee1.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_33cb476184c8e2fd1423edcf0d38cee1.jpg not downloaded yet
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_f91e26fd307eb0836eb9d254b01a9760.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_f91e26fd307eb0836eb9d254b01a9760.jpg not downloaded yet
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_bedb78869f63cd5a2c3f98ab0e070f32.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_bedb78869f63cd5a2c3f98ab0e070f32.jpg not downloaded yet
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_c70a14e27554ccc43e8fb94254e15998.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_c70a14e27554ccc43e8fb94254e15998.jpg not downloaded yet
2026-03-20 10:19:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-20 10:19:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5727513d-93cb-5a28-a9c2-3deb89ee0476 with scrape type 1
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 5727513d-93cb-5a28-a9c2-3deb89ee0476
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fe9%252F48e91993e59a79cbd817ede5be7292ad%252Fpa%252FLD78562_308bf0ab92881b8595b1022bfdcb1d0c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_308bf0ab92881b8595b1022bfdcb1d0c.jpg not downloaded yet
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_6257fb935679ccdc5ca86d85e8f1d8ba.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_6257fb935679ccdc5ca86d85e8f1d8ba.jpg not downloaded yet
2026-03-20 10:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fe9%252F48e91993e59a79cbd817ede5be7292ad%252Fpa%252FLD78562_d687b4af8a131c150129c61088d18574.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_d687b4af8a131c150129c61088d18574.jpg not downloaded yet
2026-03-20 10:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC52730> (referer: https://www.auto1.com/v1/car-details-view/RC52730/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fe9%252F48e91993e59a79cbd817ede5be7292ad%252Fpa%252FLD78562_cc5c8df0ca8aa38b87e37f9c6ee5285b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_cc5c8df0ca8aa38b87e37f9c6ee5285b.jpg not downloaded yet
2026-03-20 10:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB59132> (referer: https://www.auto1.com/v1/car-details-view/JB59132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fe9%252F48e91993e59a79cbd817ede5be7292ad%252Fpa%252FLD78562_4bb1fda65f23c47098b44a496a96ce99.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_4bb1fda65f23c47098b44a496a96ce99.jpg not downloaded yet
2026-03-20 10:19:20 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 1055 | hits on page: 40
2026-03-20 10:19:20 [auto1.nl] INFO: Found listing with ID: RY59251
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY59251%27 HTTP/1.1" 200 None
2026-03-20 10:19:20 [auto1.nl] INFO: Scrape type for RY59251: 2
2026-03-20 10:19:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b45b6ffb-c7cf-548b-812e-062642a90dfb with identifier: RY59251
2026-03-20 10:19:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b45b6ffb-c7cf-548b-812e-062642a90dfb with scrape type 2
2026-03-20 10:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b45b6ffb-c7cf-548b-812e-062642a90dfb with scrape type 2
2026-03-20 10:19:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b45b6ffb-c7cf-548b-812e-062642a90dfb, identifier: RY59251
2026-03-20 10:19:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b45b6ffb-c7cf-548b-812e-062642a90dfb with identifier: RY59251
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-20 10:19:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b45b6ffb-c7cf-548b-812e-062642a90dfb with identifier: RY59251
2026-03-20 10:19:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b45b6ffb-c7cf-548b-812e-062642a90dfb with identifier: RY59251 to the API
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-21T16:11:49Z',
 'fuel_type': 'petrol',
 'id': 'b45b6ffb-c7cf-548b-812e-062642a90dfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY59251',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Saxo',
 'odometer': 195775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-01-29',
 'seller_name': None,
 'title': 'Citroen Saxo 1.1 Chrono',
 'transmission': 'manual',
 'trim': 'Chrono',
 'year': 2002}
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY59251%27 HTTP/1.1" 200 None
2026-03-20 10:19:21 [auto1.nl] INFO: Saving data for RY59251: {'auction_closing_time': 1774109509.0, 'created_time': 1773489661.75559, 'last_price_update_time': 1774001961.593384}
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY59251') HTTP/1.1" 204 0
2026-03-20 10:19:21 [auto1.nl] INFO: Found listing with ID: YY30862
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YY30862%27 HTTP/1.1" 200 None
2026-03-20 10:19:21 [auto1.nl] INFO: Scrape type for YY30862: 2
2026-03-20 10:19:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56fc1503-7a33-555a-b182-29cce2b9aeea with identifier: YY30862
2026-03-20 10:19:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56fc1503-7a33-555a-b182-29cce2b9aeea with scrape type 2
2026-03-20 10:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56fc1503-7a33-555a-b182-29cce2b9aeea with scrape type 2
2026-03-20 10:19:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56fc1503-7a33-555a-b182-29cce2b9aeea, identifier: YY30862
2026-03-20 10:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_f0e6f3b8e9590375dace3745b62d8941.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_efa473a86a342d1319740c6e07f2865c.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56fc1503-7a33-555a-b182-29cce2b9aeea with identifier: YY30862
2026-03-20 10:19:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56fc1503-7a33-555a-b182-29cce2b9aeea with identifier: YY30862
2026-03-20 10:19:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56fc1503-7a33-555a-b182-29cce2b9aeea with identifier: YY30862 to the API
2026-03-20 10:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-21T16:07:26Z',
 'fuel_type': 'petrol',
 'id': '56fc1503-7a33-555a-b182-29cce2b9aeea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY30862',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 243771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-05',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YY30862%27 HTTP/1.1" 200 None
2026-03-20 10:19:22 [auto1.nl] INFO: Saving data for YY30862: {'auction_closing_time': 1774109246.0, 'created_time': 1773489647.465809, 'last_price_update_time': 1774001962.182726}
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YY30862') HTTP/1.1" 204 0
2026-03-20 10:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be41cafb-c1e2-5e25-97b3-180f9b8605d1 with identifier: RC52730
2026-03-20 10:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be41cafb-c1e2-5e25-97b3-180f9b8605d1 with scrape type 1
2026-03-20 10:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item be41cafb-c1e2-5e25-97b3-180f9b8605d1
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_107876338ea7ddb32ad9e65c96be0300.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_107876338ea7ddb32ad9e65c96be0300.jpg not downloaded yet
2026-03-20 10:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb with identifier: JB59132
2026-03-20 10:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb with scrape type 1
2026-03-20 10:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_38f93a1f888e06b0a446679c79b82d1a.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_38f93a1f888e06b0a446679c79b82d1a.jpg not downloaded yet
2026-03-20 10:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_4315d653f57fdf54e53f914edf330a1e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:22 [auto1.nl] INFO: Found listing with ID: XY40680
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY40680%27 HTTP/1.1" 200 None
2026-03-20 10:19:22 [auto1.nl] INFO: Scrape type for XY40680: 2
2026-03-20 10:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f71215-f69e-5c24-a85e-78f0ea93069b with identifier: XY40680
2026-03-20 10:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f71215-f69e-5c24-a85e-78f0ea93069b with scrape type 2
2026-03-20 10:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6f71215-f69e-5c24-a85e-78f0ea93069b with scrape type 2
2026-03-20 10:19:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6f71215-f69e-5c24-a85e-78f0ea93069b, identifier: XY40680
2026-03-20 10:19:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6f71215-f69e-5c24-a85e-78f0ea93069b with identifier: XY40680
2026-03-20 10:19:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6f71215-f69e-5c24-a85e-78f0ea93069b with identifier: XY40680
2026-03-20 10:19:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6f71215-f69e-5c24-a85e-78f0ea93069b with identifier: XY40680 to the API
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-21T16:31:52Z',
 'fuel_type': 'petrol',
 'id': 'e6f71215-f69e-5c24-a85e-78f0ea93069b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY40680',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 80055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-06',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY40680%27 HTTP/1.1" 200 None
2026-03-20 10:19:22 [auto1.nl] INFO: Saving data for XY40680: {'auction_closing_time': 1774110712.0, 'created_time': 1773688238.425555, 'last_price_update_time': 1774001962.789096}
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY40680') HTTP/1.1" 204 0
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_60af0ee7f82ac11358fe64316a3a73eb.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_60af0ee7f82ac11358fe64316a3a73eb.jpg not downloaded yet
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_b71ba427ae07a68587bf197e797f58c2.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_b71ba427ae07a68587bf197e797f58c2.jpg not downloaded yet
2026-03-20 10:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX69861/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:22 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR86175%27 HTTP/1.1" 200 None
2026-03-20 10:19:22 [auto1.nl] INFO: Scrape type for UR86175: 2
2026-03-20 10:19:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with identifier: UR86175
2026-03-20 10:19:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with scrape type 2
2026-03-20 10:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with scrape type 2
2026-03-20 10:19:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5ed5d71e-7e78-5c49-a860-6eb7b1631726, identifier: UR86175
2026-03-20 10:19:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_4bb1fda65f23c47098b44a496a96ce99.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with identifier: UR86175
2026-03-20 10:19:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with identifier: UR86175
2026-03-20 10:19:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with identifier: UR86175 to the API
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-21T16:01:53Z',
 'fuel_type': 'petrol',
 'id': '5ed5d71e-7e78-5c49-a860-6eb7b1631726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR86175',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 373330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-11',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Conceptline',
 'transmission': 'manual',
 'trim': 'Conceptline',
 'year': 2010}
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR86175%27 HTTP/1.1" 200 None
2026-03-20 10:19:23 [auto1.nl] INFO: Saving data for UR86175: {'auction_closing_time': 1774108913.0, 'created_time': 1773688228.524471, 'last_price_update_time': 1774001963.343821}
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UR86175') HTTP/1.1" 204 0
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_6f54f8ab959744a9c80af828e34f48b3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_6f54f8ab959744a9c80af828e34f48b3.jpg not downloaded yet
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_d95e68aea7580176603977b7bc16a2df.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_d95e68aea7580176603977b7bc16a2df.jpg not downloaded yet
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c89a50>
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_f0e6f3b8e9590375dace3745b62d8941.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_f0e6f3b8e9590375dace3745b62d8941.jpg saved to cache
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c84e50>
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_efa473a86a342d1319740c6e07f2865c.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_efa473a86a342d1319740c6e07f2865c.jpg saved to cache
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a1b010>
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_4315d653f57fdf54e53f914edf330a1e.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_4315d653f57fdf54e53f914edf330a1e.jpg saved to cache
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:23 [auto1.nl] INFO: Found listing with ID: RD99814
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD99814%27 HTTP/1.1" 200 None
2026-03-20 10:19:23 [auto1.nl] INFO: Scrape type for RD99814: 1
2026-03-20 10:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR30932/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD85278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_6257fb935679ccdc5ca86d85e8f1d8ba.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_b8066f2b85471c9f0f9ba305688110b4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_b8066f2b85471c9f0f9ba305688110b4.jpg not downloaded yet
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_e473b06844cac3d9b8581d62f430ea6e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_e473b06844cac3d9b8581d62f430ea6e.jpg not downloaded yet
2026-03-20 10:19:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV57323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_d687b4af8a131c150129c61088d18574.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_cc5c8df0ca8aa38b87e37f9c6ee5285b.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:23 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-20 10:19:23 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-20 10:19:23 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC64486%27 HTTP/1.1" 200 None
2026-03-20 10:19:23 [auto1.nl] INFO: Scrape type for PC64486: 0
2026-03-20 10:19:23 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH67432%27 HTTP/1.1" 200 None
2026-03-20 10:19:23 [auto1.nl] INFO: Scrape type for LH67432: 2
2026-03-20 10:19:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35fad8bc-dde9-58df-8e1a-ab9135678d09 with identifier: LH67432
2026-03-20 10:19:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35fad8bc-dde9-58df-8e1a-ab9135678d09 with scrape type 2
2026-03-20 10:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35fad8bc-dde9-58df-8e1a-ab9135678d09 with scrape type 2
2026-03-20 10:19:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 35fad8bc-dde9-58df-8e1a-ab9135678d09, identifier: LH67432
2026-03-20 10:19:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a27e90>
2026-03-20 10:19:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5727513d-93cb-5a28-a9c2-3deb89ee0476/5727513d-93cb-5a28-a9c2-3deb89ee0476_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fe9%252F48e91993e59a79cbd817ede5be7292ad%252Fpa%252FLD78562_4bb1fda65f23c47098b44a496a96ce99.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_4bb1fda65f23c47098b44a496a96ce99.jpg saved to cache
2026-03-20 10:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5727513d-93cb-5a28-a9c2-3deb89ee0476
2026-03-20 10:19:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 35fad8bc-dde9-58df-8e1a-ab9135678d09 with identifier: LH67432
2026-03-20 10:19:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 35fad8bc-dde9-58df-8e1a-ab9135678d09 with identifier: LH67432
2026-03-20 10:19:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 35fad8bc-dde9-58df-8e1a-ab9135678d09 with identifier: LH67432 to the API
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-21T16:05:34Z',
 'fuel_type': 'petrol',
 'id': '35fad8bc-dde9-58df-8e1a-ab9135678d09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH67432',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 150556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-02',
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH67432%27 HTTP/1.1" 200 None
2026-03-20 10:19:24 [auto1.nl] INFO: Saving data for LH67432: {'auction_closing_time': 1774109134.0, 'created_time': 1773688356.552638, 'last_price_update_time': 1774001964.557287}
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH67432') HTTP/1.1" 204 0
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_083648756019793615b13c9bde8cbfee.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_083648756019793615b13c9bde8cbfee.jpg not downloaded yet
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_bae3d0be344f4f41613edca0e5505c2c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_bae3d0be344f4f41613edca0e5505c2c.jpg not downloaded yet
2026-03-20 10:19:24 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF33290%27 HTTP/1.1" 200 None
2026-03-20 10:19:24 [auto1.nl] INFO: Scrape type for FF33290: 0
2026-03-20 10:19:24 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX87704%27 HTTP/1.1" 200 None
2026-03-20 10:19:24 [auto1.nl] INFO: Scrape type for MX87704: 2
2026-03-20 10:19:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26202789-454c-5625-bf26-72a712b69b2a with identifier: MX87704
2026-03-20 10:19:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26202789-454c-5625-bf26-72a712b69b2a with scrape type 2
2026-03-20 10:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26202789-454c-5625-bf26-72a712b69b2a with scrape type 2
2026-03-20 10:19:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 26202789-454c-5625-bf26-72a712b69b2a, identifier: MX87704
2026-03-20 10:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_b71ba427ae07a68587bf197e797f58c2.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_60af0ee7f82ac11358fe64316a3a73eb.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 26202789-454c-5625-bf26-72a712b69b2a with identifier: MX87704
2026-03-20 10:19:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 26202789-454c-5625-bf26-72a712b69b2a with identifier: MX87704
2026-03-20 10:19:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 26202789-454c-5625-bf26-72a712b69b2a with identifier: MX87704 to the API
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-21T16:45:24Z',
 'fuel_type': 'petrol',
 'id': '26202789-454c-5625-bf26-72a712b69b2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX87704',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 101954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-14',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 CATCH ME Now',
 'transmission': 'manual',
 'trim': 'CATCH ME Now',
 'year': 2008}
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX87704%27 HTTP/1.1" 200 None
2026-03-20 10:19:25 [auto1.nl] INFO: Saving data for MX87704: {'auction_closing_time': 1774111524.0, 'created_time': 1773688658.441525, 'last_price_update_time': 1774001965.218684}
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MX87704') HTTP/1.1" 204 0
2026-03-20 10:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK51587> (referer: https://www.auto1.com/v1/car-details-view/DK51587/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b219d0>
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_6257fb935679ccdc5ca86d85e8f1d8ba.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_6257fb935679ccdc5ca86d85e8f1d8ba.jpg saved to cache
2026-03-20 10:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf819ad290>
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5727513d-93cb-5a28-a9c2-3deb89ee0476/5727513d-93cb-5a28-a9c2-3deb89ee0476_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fe9%252F48e91993e59a79cbd817ede5be7292ad%252Fpa%252FLD78562_d687b4af8a131c150129c61088d18574.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_d687b4af8a131c150129c61088d18574.jpg saved to cache
2026-03-20 10:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5727513d-93cb-5a28-a9c2-3deb89ee0476
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8194c590>
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5727513d-93cb-5a28-a9c2-3deb89ee0476/5727513d-93cb-5a28-a9c2-3deb89ee0476_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fe9%252F48e91993e59a79cbd817ede5be7292ad%252Fpa%252FLD78562_cc5c8df0ca8aa38b87e37f9c6ee5285b.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_cc5c8df0ca8aa38b87e37f9c6ee5285b.jpg saved to cache
2026-03-20 10:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5727513d-93cb-5a28-a9c2-3deb89ee0476
2026-03-20 10:19:25 [auto1.nl] INFO: Found listing with ID: JY10471
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY10471%27 HTTP/1.1" 200 None
2026-03-20 10:19:25 [auto1.nl] INFO: Scrape type for JY10471: 2
2026-03-20 10:19:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 018dc13c-9676-586f-9fa2-6e83d18b96b5 with identifier: JY10471
2026-03-20 10:19:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 018dc13c-9676-586f-9fa2-6e83d18b96b5 with scrape type 2
2026-03-20 10:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 018dc13c-9676-586f-9fa2-6e83d18b96b5 with scrape type 2
2026-03-20 10:19:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 018dc13c-9676-586f-9fa2-6e83d18b96b5, identifier: JY10471
2026-03-20 10:19:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT83355> (referer: https://www.auto1.com/v1/car-details-view/HT83355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF06657> (referer: https://www.auto1.com/v1/car-details-view/JF06657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_d95e68aea7580176603977b7bc16a2df.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_38f93a1f888e06b0a446679c79b82d1a.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_6f54f8ab959744a9c80af828e34f48b3.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 018dc13c-9676-586f-9fa2-6e83d18b96b5 with identifier: JY10471
2026-03-20 10:19:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 018dc13c-9676-586f-9fa2-6e83d18b96b5 with identifier: JY10471
2026-03-20 10:19:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 018dc13c-9676-586f-9fa2-6e83d18b96b5 with identifier: JY10471 to the API
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-21T16:04:15Z',
 'fuel_type': 'petrol',
 'id': '018dc13c-9676-586f-9fa2-6e83d18b96b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY10471',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 311896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY10471%27 HTTP/1.1" 200 None
2026-03-20 10:19:25 [auto1.nl] INFO: Saving data for JY10471: {'auction_closing_time': 1774109055.0, 'created_time': 1773688038.601928, 'last_price_update_time': 1774001965.9978}
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JY10471') HTTP/1.1" 204 0
2026-03-20 10:19:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA77445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:26 [auto1.nl] INFO: Found listing with ID: CU77408
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU77408%27 HTTP/1.1" 200 None
2026-03-20 10:19:26 [auto1.nl] INFO: Scrape type for CU77408: 2
2026-03-20 10:19:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0705c99a-9708-5b5c-851b-3a9eb3607871 with identifier: CU77408
2026-03-20 10:19:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0705c99a-9708-5b5c-851b-3a9eb3607871 with scrape type 2
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0705c99a-9708-5b5c-851b-3a9eb3607871 with scrape type 2
2026-03-20 10:19:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0705c99a-9708-5b5c-851b-3a9eb3607871, identifier: CU77408
2026-03-20 10:19:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a58390>
2026-03-20 10:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_b71ba427ae07a68587bf197e797f58c2.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_b71ba427ae07a68587bf197e797f58c2.jpg saved to cache
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb
2026-03-20 10:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a90150>
2026-03-20 10:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_60af0ee7f82ac11358fe64316a3a73eb.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_60af0ee7f82ac11358fe64316a3a73eb.jpg saved to cache
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be41cafb-c1e2-5e25-97b3-180f9b8605d1
2026-03-20 10:19:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8789a205-9e07-534c-9e92-0e1a4f8a7d17 with identifier: DK51587
2026-03-20 10:19:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17 with scrape type 1
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_ae2032405099f06f42a8d97907ed4812.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_ae2032405099f06f42a8d97907ed4812.jpg not downloaded yet
2026-03-20 10:19:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0705c99a-9708-5b5c-851b-3a9eb3607871 with identifier: CU77408
2026-03-20 10:19:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0705c99a-9708-5b5c-851b-3a9eb3607871 with identifier: CU77408
2026-03-20 10:19:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0705c99a-9708-5b5c-851b-3a9eb3607871 with identifier: CU77408 to the API
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-21T16:24:24Z',
 'fuel_type': 'hybrid',
 'id': '0705c99a-9708-5b5c-851b-3a9eb3607871',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU77408',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 163897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU77408%27 HTTP/1.1" 200 None
2026-03-20 10:19:26 [auto1.nl] INFO: Saving data for CU77408: {'auction_closing_time': 1774110264.0, 'created_time': 1773232427.765994, 'last_price_update_time': 1774001966.630778}
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CU77408') HTTP/1.1" 204 0
2026-03-20 10:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_bae3d0be344f4f41613edca0e5505c2c.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_083648756019793615b13c9bde8cbfee.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:26 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-20 10:19:26 [auto1.nl] INFO: Scrape type for FJ04475: 2
2026-03-20 10:19:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475
2026-03-20 10:19:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b249a31f-66af-5e6c-9918-fdb2ad096d7e with scrape type 2
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b249a31f-66af-5e6c-9918-fdb2ad096d7e with scrape type 2
2026-03-20 10:19:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b249a31f-66af-5e6c-9918-fdb2ad096d7e, identifier: FJ04475
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_c24137d290b4e794b753ab0fc4f17f1e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_c24137d290b4e794b753ab0fc4f17f1e.jpg not downloaded yet
2026-03-20 10:19:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 038e79aa-dfe9-5839-86ee-67e93f8a8d0f with identifier: HT83355
2026-03-20 10:19:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f with scrape type 1
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_5b495824003abf14ca6f26af2514f78d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_5b495824003abf14ca6f26af2514f78d.jpg not downloaded yet
2026-03-20 10:19:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8b1711c-207c-5636-9123-720bcad08642 with identifier: JF06657
2026-03-20 10:19:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8b1711c-207c-5636-9123-720bcad08642 with scrape type 1
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8b1711c-207c-5636-9123-720bcad08642
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_17829406a45130c6d33444087f2110dc.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_17829406a45130c6d33444087f2110dc.jpg already downloaded
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_7798560d5c6dc3c777383d96562f7ea4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_7798560d5c6dc3c777383d96562f7ea4.jpg already downloaded
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_0f51e03c2e9fa067452668584f9a9e1c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_0f51e03c2e9fa067452668584f9a9e1c.jpg already downloaded
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_e0fff44809df012c4f89cf867afda810.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_e0fff44809df012c4f89cf867afda810.jpg already downloaded
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_5911e307a6d877f0bbf4435a4a48ef34.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_5911e307a6d877f0bbf4435a4a48ef34.jpg already downloaded
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_aae91f4d752b361bfe1b75609eeb7d72.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_aae91f4d752b361bfe1b75609eeb7d72.jpg already downloaded
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_b048f09e399a52a3bacb4dc15b0c1c69.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_b048f09e399a52a3bacb4dc15b0c1c69.jpg already downloaded
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_cd0de8a1ce11dde314b42d3a9b94637e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_cd0de8a1ce11dde314b42d3a9b94637e.jpg already downloaded
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_dc0084f4574e8601bc229f3dd854f79e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_dc0084f4574e8601bc229f3dd854f79e.jpg already downloaded
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F64%252F4f647bb886d2c9fc9cb1a979d0276703%252Fpa%252FJF06657_fafa95c29743120999ad26bd99aeee5f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_fafa95c29743120999ad26bd99aeee5f.jpg already downloaded
2026-03-20 10:19:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c8b1711c-207c-5636-9123-720bcad08642, identifier: JF06657
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c34790>
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_d95e68aea7580176603977b7bc16a2df.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_d95e68aea7580176603977b7bc16a2df.jpg saved to cache
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81081450>
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_38f93a1f888e06b0a446679c79b82d1a.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_38f93a1f888e06b0a446679c79b82d1a.jpg saved to cache
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b97ad0>
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_6f54f8ab959744a9c80af828e34f48b3.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_6f54f8ab959744a9c80af828e34f48b3.jpg saved to cache
2026-03-20 10:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be41cafb-c1e2-5e25-97b3-180f9b8605d1
2026-03-20 10:19:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475
2026-03-20 10:19:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475
2026-03-20 10:19:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b249a31f-66af-5e6c-9918-fdb2ad096d7e with identifier: FJ04475 to the API
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-21T16:37:13Z',
 'fuel_type': 'petrol',
 'id': 'b249a31f-66af-5e6c-9918-fdb2ad096d7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ04475',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 264799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2012}
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-20 10:19:27 [auto1.nl] INFO: Saving data for FJ04475: {'auction_closing_time': 1774111033.0, 'created_time': 1773664237.04298, 'last_price_update_time': 1774001967.946788}
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ04475') HTTP/1.1" 204 0
2026-03-20 10:19:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c8b1711c-207c-5636-9123-720bcad08642 with identifier: JF06657
2026-03-20 10:19:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c8b1711c-207c-5636-9123-720bcad08642 with identifier: JF06657
2026-03-20 10:19:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c8b1711c-207c-5636-9123-720bcad08642 with identifier: JF06657 to the API
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF06657>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-21T16:00:10Z',
 'fuel_type': 'petrol',
 'id': 'c8b1711c-207c-5636-9123-720bcad08642',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HXL-39-J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF06657',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 160013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_17829406a45130c6d33444087f2110dc.jpg',
                'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_7798560d5c6dc3c777383d96562f7ea4.jpg',
                'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_0f51e03c2e9fa067452668584f9a9e1c.jpg',
                'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_e0fff44809df012c4f89cf867afda810.jpg',
                'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_5911e307a6d877f0bbf4435a4a48ef34.jpg',
                'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_aae91f4d752b361bfe1b75609eeb7d72.jpg',
                'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_b048f09e399a52a3bacb4dc15b0c1c69.jpg',
                'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_cd0de8a1ce11dde314b42d3a9b94637e.jpg',
                'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_dc0084f4574e8601bc229f3dd854f79e.jpg',
                'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_fafa95c29743120999ad26bd99aeee5f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_17829406a45130c6d33444087f2110dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_7798560d5c6dc3c777383d96562f7ea4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_0f51e03c2e9fa067452668584f9a9e1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_e0fff44809df012c4f89cf867afda810.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_5911e307a6d877f0bbf4435a4a48ef34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_aae91f4d752b361bfe1b75609eeb7d72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_b048f09e399a52a3bacb4dc15b0c1c69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_cd0de8a1ce11dde314b42d3a9b94637e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_dc0084f4574e8601bc229f3dd854f79e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8b1711c-207c-5636-9123-720bcad08642/c8b1711c-207c-5636-9123-720bcad08642_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/64/4f647bb886d2c9fc9cb1a979d0276703/pa/JF06657_fafa95c29743120999ad26bd99aeee5f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Lounge BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech.',
 'year': 2015}
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF06657%27 HTTP/1.1" 200 None
2026-03-20 10:19:28 [auto1.nl] INFO: Saving data for JF06657: {'created_time': 1774001968.314731, 'last_price_update_time': 1774001968.314748, 'auction_closing_time': 1774108810.0}
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JF06657') HTTP/1.1" 204 0
2026-03-20 10:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_e473b06844cac3d9b8581d62f430ea6e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_b8066f2b85471c9f0f9ba305688110b4.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:28 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-20 10:19:28 [auto1.nl] INFO: Scrape type for LW17731: 2
2026-03-20 10:19:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731
2026-03-20 10:19:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d195d9c7-1662-5d32-845c-dddf89cb6c27 with scrape type 2
2026-03-20 10:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d195d9c7-1662-5d32-845c-dddf89cb6c27 with scrape type 2
2026-03-20 10:19:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d195d9c7-1662-5d32-845c-dddf89cb6c27, identifier: LW17731
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_105319b7220d83b40727c98982d42226.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_105319b7220d83b40727c98982d42226.jpg not downloaded yet
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_50be1a00eaf266f88b979f43dab7688c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_50be1a00eaf266f88b979f43dab7688c.jpg not downloaded yet
2026-03-20 10:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF13985/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL68396> (referer: https://www.auto1.com/v1/car-details-view/TL68396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_c70a14e27554ccc43e8fb94254e15998.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731
2026-03-20 10:19:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731
2026-03-20 10:19:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731 to the API
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-21T16:02:12Z',
 'fuel_type': 'petrol',
 'id': 'd195d9c7-1662-5d32-845c-dddf89cb6c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW17731',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 163770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-12-18',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2003}
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-20 10:19:28 [auto1.nl] INFO: Saving data for LW17731: {'auction_closing_time': 1774108932.0, 'created_time': 1773514907.65098, 'last_price_update_time': 1774001968.847921}
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LW17731') HTTP/1.1" 204 0
2026-03-20 10:19:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC74533> (referer: https://www.auto1.com/v1/car-details-view/TC74533/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a7c850>
2026-03-20 10:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_bae3d0be344f4f41613edca0e5505c2c.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_bae3d0be344f4f41613edca0e5505c2c.jpg saved to cache
2026-03-20 10:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb
2026-03-20 10:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81bc5410>
2026-03-20 10:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_083648756019793615b13c9bde8cbfee.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_083648756019793615b13c9bde8cbfee.jpg saved to cache
2026-03-20 10:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be41cafb-c1e2-5e25-97b3-180f9b8605d1
2026-03-20 10:19:28 [auto1.nl] INFO: Found listing with ID: NH24631
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH24631%27 HTTP/1.1" 200 None
2026-03-20 10:19:28 [auto1.nl] INFO: Scrape type for NH24631: 2
2026-03-20 10:19:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d1fd60-caec-5fc6-aa63-c9998f1b8238 with identifier: NH24631
2026-03-20 10:19:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d1fd60-caec-5fc6-aa63-c9998f1b8238 with scrape type 2
2026-03-20 10:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92d1fd60-caec-5fc6-aa63-c9998f1b8238 with scrape type 2
2026-03-20 10:19:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 92d1fd60-caec-5fc6-aa63-c9998f1b8238, identifier: NH24631
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_7c00663aa61d4f25b91185115c4a9679.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_7c00663aa61d4f25b91185115c4a9679.jpg not downloaded yet
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_aeabb14857674a3d51c4cf52980fe7c7.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_aeabb14857674a3d51c4cf52980fe7c7.jpg not downloaded yet
2026-03-20 10:19:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_107876338ea7ddb32ad9e65c96be0300.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_308bf0ab92881b8595b1022bfdcb1d0c.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_ae2032405099f06f42a8d97907ed4812.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 92d1fd60-caec-5fc6-aa63-c9998f1b8238 with identifier: NH24631
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-20 10:19:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 92d1fd60-caec-5fc6-aa63-c9998f1b8238 with identifier: NH24631
2026-03-20 10:19:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 92d1fd60-caec-5fc6-aa63-c9998f1b8238 with identifier: NH24631 to the API
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-21T16:55:21Z',
 'fuel_type': 'petrol',
 'id': '92d1fd60-caec-5fc6-aa63-c9998f1b8238',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH24631',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2002}
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH24631%27 HTTP/1.1" 200 None
2026-03-20 10:19:29 [auto1.nl] INFO: Saving data for NH24631: {'auction_closing_time': 1774112121.0, 'created_time': 1773514940.00404, 'last_price_update_time': 1774001969.59386}
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NH24631') HTTP/1.1" 204 0
2026-03-20 10:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8104c150>
2026-03-20 10:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F43%252Fba439e08df898232385e572d279707ff%252Fpa%252FJB59132_e473b06844cac3d9b8581d62f430ea6e.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_e473b06844cac3d9b8581d62f430ea6e.jpg saved to cache
2026-03-20 10:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb
2026-03-20 10:19:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb, skipping ID generation
2026-03-20 10:19:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb with scrape type 1
2026-03-20 10:19:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb sending to next pipeline
2026-03-20 10:19:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb, identifier: JB59132
2026-03-20 10:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf9176b1d0>
2026-03-20 10:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_b8066f2b85471c9f0f9ba305688110b4.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_b8066f2b85471c9f0f9ba305688110b4.jpg saved to cache
2026-03-20 10:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be41cafb-c1e2-5e25-97b3-180f9b8605d1
2026-03-20 10:19:29 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-20 10:19:29 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-20 10:19:29 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN86188%27 HTTP/1.1" 200 None
2026-03-20 10:19:29 [auto1.nl] INFO: Scrape type for TN86188: 0
2026-03-20 10:19:29 [auto1.nl] INFO: Found listing with ID: VK93798
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK93798%27 HTTP/1.1" 200 None
2026-03-20 10:19:29 [auto1.nl] INFO: Scrape type for VK93798: 0
2026-03-20 10:19:29 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT06250%27 HTTP/1.1" 200 None
2026-03-20 10:19:29 [auto1.nl] INFO: Scrape type for AT06250: 2
2026-03-20 10:19:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250
2026-03-20 10:19:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657fc4a3-6836-5e36-9e93-986b184640ec with scrape type 2
2026-03-20 10:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 657fc4a3-6836-5e36-9e93-986b184640ec with scrape type 2
2026-03-20 10:19:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 657fc4a3-6836-5e36-9e93-986b184640ec, identifier: AT06250
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_701da0767161b84ca18bc04f8b0be1e4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_701da0767161b84ca18bc04f8b0be1e4.jpg not downloaded yet
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_bd5c31a94f15ae09e8035530f20f0a1a.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_bd5c31a94f15ae09e8035530f20f0a1a.jpg not downloaded yet
2026-03-20 10:19:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb with identifier: JB59132
2026-03-20 10:19:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb with identifier: JB59132
2026-03-20 10:19:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb with identifier: JB59132 to the API
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_e473b06844cac3d9b8581d62f430ea6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-21T16:47:40Z',
 'fuel_type': 'petrol',
 'id': 'b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '97JKZ9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB59132',
 'listing': 'auction',
 'location': 'NL, Apeldoorn',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 276904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_38f93a1f888e06b0a446679c79b82d1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_b71ba427ae07a68587bf197e797f58c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_d95e68aea7580176603977b7bc16a2df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_e473b06844cac3d9b8581d62f430ea6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb/b96a85d0-16d6-5e0e-85f7-6ef0b75fcefb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/43/ba439e08df898232385e572d279707ff/pa/JB59132_bae3d0be344f4f41613edca0e5505c2c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2009}
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB59132%27 HTTP/1.1" 200 None
2026-03-20 10:19:30 [auto1.nl] INFO: Saving data for JB59132: {'created_time': 1774001970.556811, 'last_price_update_time': 1774001970.556822, 'auction_closing_time': 1774111660.0}
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB59132') HTTP/1.1" 204 0
2026-03-20 10:19:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6a4420-be2b-56b4-8004-345bc2507287 with identifier: TL68396
2026-03-20 10:19:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6a4420-be2b-56b4-8004-345bc2507287 with scrape type 1
2026-03-20 10:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_4f86e80c19526e6f479b0a91c188c1dc.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_4f86e80c19526e6f479b0a91c188c1dc.jpg not downloaded yet
2026-03-20 10:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a2ef50>
2026-03-20 10:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_c70a14e27554ccc43e8fb94254e15998.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_c70a14e27554ccc43e8fb94254e15998.jpg saved to cache
2026-03-20 10:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_5b495824003abf14ca6f26af2514f78d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250
2026-03-20 10:19:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250
2026-03-20 10:19:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 657fc4a3-6836-5e36-9e93-986b184640ec with identifier: AT06250 to the API
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-21T16:18:13Z',
 'fuel_type': 'petrol',
 'id': '657fc4a3-6836-5e36-9e93-986b184640ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT06250',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 83795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT06250%27 HTTP/1.1" 200 None
2026-03-20 10:19:31 [auto1.nl] INFO: Saving data for AT06250: {'auction_closing_time': 1774109893.0, 'created_time': 1773232172.092675, 'last_price_update_time': 1774001971.072817}
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AT06250') HTTP/1.1" 204 0
2026-03-20 10:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_c24137d290b4e794b753ab0fc4f17f1e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_f91e26fd307eb0836eb9d254b01a9760.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_bedb78869f63cd5a2c3f98ab0e070f32.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:31 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-20 10:19:31 [auto1.nl] INFO: Scrape type for NG83103: 2
2026-03-20 10:19:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103
2026-03-20 10:19:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6d9171-6b59-550e-aeeb-96d27288907e with scrape type 2
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6d9171-6b59-550e-aeeb-96d27288907e with scrape type 2
2026-03-20 10:19:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e6d9171-6b59-550e-aeeb-96d27288907e, identifier: NG83103
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_8763059cfcbbbf3fe5711d3da757c869.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_8763059cfcbbbf3fe5711d3da757c869.jpg not downloaded yet
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_572d957f212db9a89578d03ab7e7cbd2.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_572d957f212db9a89578d03ab7e7cbd2.jpg not downloaded yet
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_ccc76ec9573434bdde75afa802b65c04.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_ccc76ec9573434bdde75afa802b65c04.jpg not downloaded yet
2026-03-20 10:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV57323> (referer: https://www.auto1.com/v1/car-details-view/CV57323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD85278> (referer: https://www.auto1.com/v1/car-details-view/AD85278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8476bd7c-64dc-568e-b34e-864910b5912d with identifier: TC74533
2026-03-20 10:19:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8476bd7c-64dc-568e-b34e-864910b5912d with scrape type 1
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8476bd7c-64dc-568e-b34e-864910b5912d
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_9ca92ba3b3a36b96456d68eca1528c5c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_9ca92ba3b3a36b96456d68eca1528c5c.jpg not downloaded yet
2026-03-20 10:19:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:31 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 1055 | hits on page: 40
2026-03-20 10:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf810e9bd0>
2026-03-20 10:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F15%252F53153ec723c3b7fa235a1bfb06f353a0%252Fpa%252FRC52730_107876338ea7ddb32ad9e65c96be0300.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_107876338ea7ddb32ad9e65c96be0300.jpg saved to cache
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be41cafb-c1e2-5e25-97b3-180f9b8605d1
2026-03-20 10:19:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be41cafb-c1e2-5e25-97b3-180f9b8605d1, skipping ID generation
2026-03-20 10:19:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be41cafb-c1e2-5e25-97b3-180f9b8605d1 with scrape type 1
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be41cafb-c1e2-5e25-97b3-180f9b8605d1 sending to next pipeline
2026-03-20 10:19:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: be41cafb-c1e2-5e25-97b3-180f9b8605d1, identifier: RC52730
2026-03-20 10:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf810dab90>
2026-03-20 10:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5727513d-93cb-5a28-a9c2-3deb89ee0476/5727513d-93cb-5a28-a9c2-3deb89ee0476_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fe9%252F48e91993e59a79cbd817ede5be7292ad%252Fpa%252FLD78562_308bf0ab92881b8595b1022bfdcb1d0c.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_308bf0ab92881b8595b1022bfdcb1d0c.jpg saved to cache
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5727513d-93cb-5a28-a9c2-3deb89ee0476
2026-03-20 10:19:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5727513d-93cb-5a28-a9c2-3deb89ee0476, skipping ID generation
2026-03-20 10:19:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5727513d-93cb-5a28-a9c2-3deb89ee0476 with scrape type 1
2026-03-20 10:19:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5727513d-93cb-5a28-a9c2-3deb89ee0476 sending to next pipeline
2026-03-20 10:19:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5727513d-93cb-5a28-a9c2-3deb89ee0476, identifier: LD78562
2026-03-20 10:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81068390>
2026-03-20 10:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_ae2032405099f06f42a8d97907ed4812.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_ae2032405099f06f42a8d97907ed4812.jpg saved to cache
2026-03-20 10:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17
2026-03-20 10:19:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103
2026-03-20 10:19:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103
2026-03-20 10:19:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103 to the API
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-21T16:36:22Z',
 'fuel_type': 'petrol',
 'id': '2e6d9171-6b59-550e-aeeb-96d27288907e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG83103',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 82399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Style',
 'year': 2018}
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-20 10:19:32 [auto1.nl] INFO: Saving data for NG83103: {'auction_closing_time': 1774110982.0, 'created_time': 1773688224.036253, 'last_price_update_time': 1774001972.385628}
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NG83103') HTTP/1.1" 204 0
2026-03-20 10:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX69861> (referer: https://www.auto1.com/v1/car-details-view/HX69861/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: be41cafb-c1e2-5e25-97b3-180f9b8605d1 with identifier: RC52730
2026-03-20 10:19:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: be41cafb-c1e2-5e25-97b3-180f9b8605d1 with identifier: RC52730
2026-03-20 10:19:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: be41cafb-c1e2-5e25-97b3-180f9b8605d1 with identifier: RC52730 to the API
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_107876338ea7ddb32ad9e65c96be0300.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-21T16:26:17Z',
 'fuel_type': 'petrol',
 'id': 'be41cafb-c1e2-5e25-97b3-180f9b8605d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '09GFK9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC52730',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 213921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_107876338ea7ddb32ad9e65c96be0300.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_60af0ee7f82ac11358fe64316a3a73eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_6f54f8ab959744a9c80af828e34f48b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_b8066f2b85471c9f0f9ba305688110b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be41cafb-c1e2-5e25-97b3-180f9b8605d1/be41cafb-c1e2-5e25-97b3-180f9b8605d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/15/53153ec723c3b7fa235a1bfb06f353a0/pa/RC52730_083648756019793615b13c9bde8cbfee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 CATCH ME Now',
 'transmission': 'manual',
 'trim': 'CATCH ME Now',
 'year': 2008}
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC52730%27 HTTP/1.1" 200 None
2026-03-20 10:19:32 [auto1.nl] INFO: Saving data for RC52730: {'created_time': 1774001972.867163, 'last_price_update_time': 1774001972.867173, 'auction_closing_time': 1774110377.0}
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC52730') HTTP/1.1" 204 0
2026-03-20 10:19:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-20 10:19:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-20 10:19:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562 to the API
2026-03-20 10:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_308bf0ab92881b8595b1022bfdcb1d0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-21T16:40:41Z',
 'fuel_type': 'petrol',
 'id': '5727513d-93cb-5a28-a9c2-3deb89ee0476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '52SLRT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD78562',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 295518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5727513d-93cb-5a28-a9c2-3deb89ee0476/5727513d-93cb-5a28-a9c2-3deb89ee0476_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_308bf0ab92881b8595b1022bfdcb1d0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5727513d-93cb-5a28-a9c2-3deb89ee0476/5727513d-93cb-5a28-a9c2-3deb89ee0476_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_d687b4af8a131c150129c61088d18574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5727513d-93cb-5a28-a9c2-3deb89ee0476/5727513d-93cb-5a28-a9c2-3deb89ee0476_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_cc5c8df0ca8aa38b87e37f9c6ee5285b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5727513d-93cb-5a28-a9c2-3deb89ee0476/5727513d-93cb-5a28-a9c2-3deb89ee0476_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/e9/48e91993e59a79cbd817ede5be7292ad/pa/LD78562_4bb1fda65f23c47098b44a496a96ce99.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.6 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-20 10:19:33 [auto1.nl] INFO: Saving data for LD78562: {'created_time': 1774001973.259294, 'last_price_update_time': 1774001973.259304, 'auction_closing_time': 1774111241.0}
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LD78562') HTTP/1.1" 204 0
2026-03-20 10:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_105319b7220d83b40727c98982d42226.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_57c856dd6ca266c71de6ea0be0723a13.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_33cb476184c8e2fd1423edcf0d38cee1.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:33 [scrapy.extensions.logstats] INFO: Crawled 49 pages (at 49 pages/min), scraped 27 items (at 27 items/min)
2026-03-20 10:19:33 [scrapy.extensions.memusage] INFO: Peak memory usage is 166MiB
2026-03-20 10:19:33 [auto1.nl] INFO: Found listing with ID: BX63844
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX63844%27 HTTP/1.1" 200 None
2026-03-20 10:19:33 [auto1.nl] INFO: Scrape type for BX63844: 0
2026-03-20 10:19:33 [auto1.nl] INFO: Found listing with ID: PA83698
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA83698%27 HTTP/1.1" 200 None
2026-03-20 10:19:33 [auto1.nl] INFO: Scrape type for PA83698: 0
2026-03-20 10:19:33 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-20 10:19:33 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-20 10:19:33 [auto1.nl] INFO: Found listing with ID: VN23813
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN23813%27 HTTP/1.1" 200 None
2026-03-20 10:19:33 [auto1.nl] INFO: Scrape type for VN23813: 2
2026-03-20 10:19:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1b1461-6db7-59dd-bc7d-de307aaead2d with identifier: VN23813
2026-03-20 10:19:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1b1461-6db7-59dd-bc7d-de307aaead2d with scrape type 2
2026-03-20 10:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1b1461-6db7-59dd-bc7d-de307aaead2d with scrape type 2
2026-03-20 10:19:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5a1b1461-6db7-59dd-bc7d-de307aaead2d, identifier: VN23813
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_910e1af17a4f4d97dcdbacc165437a85.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_910e1af17a4f4d97dcdbacc165437a85.jpg not downloaded yet
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_278e474fc4f25c2fd73f01707d265cb6.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_278e474fc4f25c2fd73f01707d265cb6.jpg not downloaded yet
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_5f513a241aaa11942a47c468a92ec8f7.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_5f513a241aaa11942a47c468a92ec8f7.jpg not downloaded yet
2026-03-20 10:19:33 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE22789%27 HTTP/1.1" 200 None
2026-03-20 10:19:33 [auto1.nl] INFO: Scrape type for ZE22789: 2
2026-03-20 10:19:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789
2026-03-20 10:19:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681857c0-ef25-5c50-82a3-b1ecb348898e with scrape type 2
2026-03-20 10:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681857c0-ef25-5c50-82a3-b1ecb348898e with scrape type 2
2026-03-20 10:19:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 681857c0-ef25-5c50-82a3-b1ecb348898e, identifier: ZE22789
2026-03-20 10:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD99814/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8194c8d0>
2026-03-20 10:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_5b495824003abf14ca6f26af2514f78d.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_5b495824003abf14ca6f26af2514f78d.jpg saved to cache
2026-03-20 10:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:19:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5a1b1461-6db7-59dd-bc7d-de307aaead2d with identifier: VN23813
2026-03-20 10:19:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5a1b1461-6db7-59dd-bc7d-de307aaead2d with identifier: VN23813
2026-03-20 10:19:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5a1b1461-6db7-59dd-bc7d-de307aaead2d with identifier: VN23813 to the API
2026-03-20 10:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-21T16:15:34Z',
 'fuel_type': 'petrol',
 'id': '5a1b1461-6db7-59dd-bc7d-de307aaead2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN23813',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 144264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-14',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN23813%27 HTTP/1.1" 200 None
2026-03-20 10:19:34 [auto1.nl] INFO: Saving data for VN23813: {'auction_closing_time': 1774109734.0, 'created_time': 1773688506.570896, 'last_price_update_time': 1774001974.185139}
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VN23813') HTTP/1.1" 204 0
2026-03-20 10:19:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789
2026-03-20 10:19:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789
2026-03-20 10:19:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789 to the API
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-21T16:39:00Z',
 'fuel_type': 'hybrid',
 'id': '681857c0-ef25-5c50-82a3-b1ecb348898e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE22789',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 76421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-25',
 'seller_name': None,
 'title': 'BMW 5er 530e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE22789%27 HTTP/1.1" 200 None
2026-03-20 10:19:34 [auto1.nl] INFO: Saving data for ZE22789: {'auction_closing_time': 1774111140.0, 'created_time': 1773688248.914354, 'last_price_update_time': 1774001974.676129}
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE22789') HTTP/1.1" 204 0
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c865d0>
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_c24137d290b4e794b753ab0fc4f17f1e.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_c24137d290b4e794b753ab0fc4f17f1e.jpg saved to cache
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80ef60d0>
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_f91e26fd307eb0836eb9d254b01a9760.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_f91e26fd307eb0836eb9d254b01a9760.jpg saved to cache
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80eff4d0>
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_bedb78869f63cd5a2c3f98ab0e070f32.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_bedb78869f63cd5a2c3f98ab0e070f32.jpg saved to cache
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with identifier: CV57323
2026-03-20 10:19:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with scrape type 1
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg not downloaded yet
2026-03-20 10:19:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f43db7c7-5211-573b-9ea1-2b34b361898b with identifier: AD85278
2026-03-20 10:19:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f43db7c7-5211-573b-9ea1-2b34b361898b with scrape type 1
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f43db7c7-5211-573b-9ea1-2b34b361898b
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_8ec1e0344283f85a86aef49278268341.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_8ec1e0344283f85a86aef49278268341.jpg not downloaded yet
2026-03-20 10:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_bd5c31a94f15ae09e8035530f20f0a1a.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:34 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HU61188%27 HTTP/1.1" 200 None
2026-03-20 10:19:34 [auto1.nl] INFO: Scrape type for HU61188: 0
2026-03-20 10:19:34 [auto1.nl] INFO: Found listing with ID: AG82941
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG82941%27 HTTP/1.1" 200 None
2026-03-20 10:19:34 [auto1.nl] INFO: Scrape type for AG82941: 2
2026-03-20 10:19:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c556a69f-2248-5385-a911-e15702c89924 with identifier: AG82941
2026-03-20 10:19:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c556a69f-2248-5385-a911-e15702c89924 with scrape type 2
2026-03-20 10:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c556a69f-2248-5385-a911-e15702c89924 with scrape type 2
2026-03-20 10:19:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c556a69f-2248-5385-a911-e15702c89924, identifier: AG82941
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_3fd548bca1ab2f3739d10de4780f0b87.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_3fd548bca1ab2f3739d10de4780f0b87.jpg not downloaded yet
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_542269a4861502f1a2a566a90f9815c6.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_542269a4861502f1a2a566a90f9815c6.jpg not downloaded yet
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_e0cb0a9031ae4de9e6e12d3f540781f0.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_e0cb0a9031ae4de9e6e12d3f540781f0.jpg not downloaded yet
2026-03-20 10:19:35 [auto1.nl] INFO: Found listing with ID: NZ17621
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ17621%27 HTTP/1.1" 200 None
2026-03-20 10:19:35 [auto1.nl] INFO: Scrape type for NZ17621: 2
2026-03-20 10:19:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 282c57e8-de03-58d6-ba78-0099e0f42595 with identifier: NZ17621
2026-03-20 10:19:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282c57e8-de03-58d6-ba78-0099e0f42595 with scrape type 2
2026-03-20 10:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 282c57e8-de03-58d6-ba78-0099e0f42595 with scrape type 2
2026-03-20 10:19:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 282c57e8-de03-58d6-ba78-0099e0f42595, identifier: NZ17621
2026-03-20 10:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_aeabb14857674a3d51c4cf52980fe7c7.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_4f86e80c19526e6f479b0a91c188c1dc.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_701da0767161b84ca18bc04f8b0be1e4.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c556a69f-2248-5385-a911-e15702c89924 with identifier: AG82941
2026-03-20 10:19:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c556a69f-2248-5385-a911-e15702c89924 with identifier: AG82941
2026-03-20 10:19:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c556a69f-2248-5385-a911-e15702c89924 with identifier: AG82941 to the API
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-21T16:36:53Z',
 'fuel_type': 'petrol',
 'id': 'c556a69f-2248-5385-a911-e15702c89924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG82941',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 102584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'M Sport Shadow',
 'year': 2019}
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG82941%27 HTTP/1.1" 200 None
2026-03-20 10:19:35 [auto1.nl] INFO: Saving data for AG82941: {'auction_closing_time': 1774111013.0, 'created_time': 1773688250.047828, 'last_price_update_time': 1774001975.623772}
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AG82941') HTTP/1.1" 204 0
2026-03-20 10:19:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 282c57e8-de03-58d6-ba78-0099e0f42595 with identifier: NZ17621
2026-03-20 10:19:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 282c57e8-de03-58d6-ba78-0099e0f42595 with identifier: NZ17621
2026-03-20 10:19:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 282c57e8-de03-58d6-ba78-0099e0f42595 with identifier: NZ17621 to the API
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-21T16:01:28Z',
 'fuel_type': 'petrol',
 'id': '282c57e8-de03-58d6-ba78-0099e0f42595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ17621',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 122190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-23',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ17621%27 HTTP/1.1" 200 None
2026-03-20 10:19:35 [auto1.nl] INFO: Saving data for NZ17621: {'auction_closing_time': 1774108888.0, 'created_time': 1773232386.138294, 'last_price_update_time': 1774001975.988152}
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ17621') HTTP/1.1" 204 0
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_db025a5473219c01920a6d2cdc2affdf.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_db025a5473219c01920a6d2cdc2affdf.jpg not downloaded yet
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_ac52f695424d19e3a33773640523178d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_ac52f695424d19e3a33773640523178d.jpg not downloaded yet
2026-03-20 10:19:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861
2026-03-20 10:19:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with scrape type 1
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_51f2d1ffd83d861d0968c7a134be24a8.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_51f2d1ffd83d861d0968c7a134be24a8.jpg not downloaded yet
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f12c50>
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_105319b7220d83b40727c98982d42226.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_105319b7220d83b40727c98982d42226.jpg saved to cache
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81026990>
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_57c856dd6ca266c71de6ea0be0723a13.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_57c856dd6ca266c71de6ea0be0723a13.jpg saved to cache
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8104ae10>
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_33cb476184c8e2fd1423edcf0d38cee1.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_33cb476184c8e2fd1423edcf0d38cee1.jpg saved to cache
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_7c00663aa61d4f25b91185115c4a9679.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:36 [auto1.nl] INFO: Found listing with ID: MP73031
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP73031%27 HTTP/1.1" 200 None
2026-03-20 10:19:36 [auto1.nl] INFO: Scrape type for MP73031: 2
2026-03-20 10:19:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46c5831e-e0f0-591a-b773-348c50420312 with identifier: MP73031
2026-03-20 10:19:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c5831e-e0f0-591a-b773-348c50420312 with scrape type 2
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46c5831e-e0f0-591a-b773-348c50420312 with scrape type 2
2026-03-20 10:19:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 46c5831e-e0f0-591a-b773-348c50420312, identifier: MP73031
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_fc0f7a66000594db012503d01326cd77.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_fc0f7a66000594db012503d01326cd77.jpg not downloaded yet
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_817e5ccaeb3c3f98722c457d63bb675e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_817e5ccaeb3c3f98722c457d63bb675e.jpg not downloaded yet
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_c45e570ba623cbb516b80f8a870abef9.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_c45e570ba623cbb516b80f8a870abef9.jpg not downloaded yet
2026-03-20 10:19:36 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK25507%27 HTTP/1.1" 200 None
2026-03-20 10:19:36 [auto1.nl] INFO: Scrape type for MK25507: 2
2026-03-20 10:19:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb731393-f5ec-59d3-af24-5908e8f46fd7 with identifier: MK25507
2026-03-20 10:19:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb731393-f5ec-59d3-af24-5908e8f46fd7 with scrape type 2
2026-03-20 10:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb731393-f5ec-59d3-af24-5908e8f46fd7 with scrape type 2
2026-03-20 10:19:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cb731393-f5ec-59d3-af24-5908e8f46fd7, identifier: MK25507
2026-03-20 10:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_9ca92ba3b3a36b96456d68eca1528c5c.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 46c5831e-e0f0-591a-b773-348c50420312 with identifier: MP73031
2026-03-20 10:19:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 46c5831e-e0f0-591a-b773-348c50420312 with identifier: MP73031
2026-03-20 10:19:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 46c5831e-e0f0-591a-b773-348c50420312 with identifier: MP73031 to the API
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-21T16:39:05Z',
 'fuel_type': 'diesel',
 'id': '46c5831e-e0f0-591a-b773-348c50420312',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP73031',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 146963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Asphalt L2',
 'transmission': 'automatic',
 'trim': 'Asphalt L2',
 'year': 2021}
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP73031%27 HTTP/1.1" 200 None
2026-03-20 10:19:36 [auto1.nl] INFO: Saving data for MP73031: {'auction_closing_time': 1774111145.0, 'created_time': 1773688326.734565, 'last_price_update_time': 1774001976.944663}
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP73031') HTTP/1.1" 204 0
2026-03-20 10:19:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cb731393-f5ec-59d3-af24-5908e8f46fd7 with identifier: MK25507
2026-03-20 10:19:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cb731393-f5ec-59d3-af24-5908e8f46fd7 with identifier: MK25507
2026-03-20 10:19:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cb731393-f5ec-59d3-af24-5908e8f46fd7 with identifier: MK25507 to the API
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-21T16:00:22Z',
 'fuel_type': 'petrol',
 'id': 'cb731393-f5ec-59d3-af24-5908e8f46fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK25507',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 53617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seller_name': None,
 'title': 'Audi A5 Sportback 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK25507%27 HTTP/1.1" 200 None
2026-03-20 10:19:37 [auto1.nl] INFO: Saving data for MK25507: {'auction_closing_time': 1774108822.0, 'created_time': 1773688363.339647, 'last_price_update_time': 1774001977.321607}
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MK25507') HTTP/1.1" 204 0
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_8ed745d21d9fc9d16f96304433931d29.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_8ed745d21d9fc9d16f96304433931d29.jpg not downloaded yet
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_f57d44d3e7a13b05a16d225c068af754.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_f57d44d3e7a13b05a16d225c068af754.jpg not downloaded yet
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_ffca66c41e1de596b69fe3f5b3f68b67.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_ffca66c41e1de596b69fe3f5b3f68b67.jpg not downloaded yet
2026-03-20 10:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_572d957f212db9a89578d03ab7e7cbd2.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_50be1a00eaf266f88b979f43dab7688c.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:37 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-20 10:19:37 [auto1.nl] INFO: Scrape type for FW01389: 2
2026-03-20 10:19:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389
2026-03-20 10:19:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e74020a-70a1-5c66-a76c-68c7d8f337dd with scrape type 2
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e74020a-70a1-5c66-a76c-68c7d8f337dd with scrape type 2
2026-03-20 10:19:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7e74020a-70a1-5c66-a76c-68c7d8f337dd, identifier: FW01389
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_9b554d6d0b9910935a7b9d5fff28e045.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_9b554d6d0b9910935a7b9d5fff28e045.jpg not downloaded yet
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_cdbaaecb6c4e5d4d42a4e5d2245f1c20.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_cdbaaecb6c4e5d4d42a4e5d2245f1c20.jpg not downloaded yet
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_34284e276c944f609bbb540beac07a20.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_34284e276c944f609bbb540beac07a20.jpg not downloaded yet
2026-03-20 10:19:37 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-20 10:19:37 [auto1.nl] INFO: Scrape type for ZJ02157: 2
2026-03-20 10:19:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157
2026-03-20 10:19:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 402093a2-ccab-5cdf-9b16-953d5eb0edbc with scrape type 2
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 402093a2-ccab-5cdf-9b16-953d5eb0edbc with scrape type 2
2026-03-20 10:19:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 402093a2-ccab-5cdf-9b16-953d5eb0edbc, identifier: ZJ02157
2026-03-20 10:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM54689> (referer: https://www.auto1.com/v1/car-details-view/EM54689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA77445> (referer: https://www.auto1.com/v1/car-details-view/HA77445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR30932> (referer: https://www.auto1.com/v1/car-details-view/KR30932/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf819ac090>
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_bd5c31a94f15ae09e8035530f20f0a1a.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_bd5c31a94f15ae09e8035530f20f0a1a.jpg saved to cache
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d48690>
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_aeabb14857674a3d51c4cf52980fe7c7.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_aeabb14857674a3d51c4cf52980fe7c7.jpg saved to cache
2026-03-20 10:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d66a10>
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_4f86e80c19526e6f479b0a91c188c1dc.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_4f86e80c19526e6f479b0a91c188c1dc.jpg saved to cache
2026-03-20 10:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c85950>
2026-03-20 10:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_701da0767161b84ca18bc04f8b0be1e4.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_701da0767161b84ca18bc04f8b0be1e4.jpg saved to cache
2026-03-20 10:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17
2026-03-20 10:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_8763059cfcbbbf3fe5711d3da757c869.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_ccc76ec9573434bdde75afa802b65c04.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389
2026-03-20 10:19:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389
2026-03-20 10:19:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389 to the API
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-21T16:59:04Z',
 'fuel_type': 'petrol',
 'id': '7e74020a-70a1-5c66-a76c-68c7d8f337dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW01389',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 174142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-23',
 'seller_name': None,
 'title': 'Renault Modus 1.4 Exception',
 'transmission': 'manual',
 'trim': 'Exception',
 'year': 2007}
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-20 10:19:38 [auto1.nl] INFO: Saving data for FW01389: {'auction_closing_time': 1774112344.0, 'created_time': 1773489728.857906, 'last_price_update_time': 1774001978.763244}
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FW01389') HTTP/1.1" 204 0
2026-03-20 10:19:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157
2026-03-20 10:19:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157
2026-03-20 10:19:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 402093a2-ccab-5cdf-9b16-953d5eb0edbc with identifier: ZJ02157 to the API
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-21T16:06:11Z',
 'fuel_type': 'petrol',
 'id': '402093a2-ccab-5cdf-9b16-953d5eb0edbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ02157',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 134313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 1.5 TSI ACT Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2020}
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ02157%27 HTTP/1.1" 200 None
2026-03-20 10:19:39 [auto1.nl] INFO: Saving data for ZJ02157: {'auction_closing_time': 1774109171.0, 'created_time': 1773688563.813232, 'last_price_update_time': 1774001979.121827}
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZJ02157') HTTP/1.1" 204 0
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg not downloaded yet
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_a3dd7b8506a10785e037376dce2d0e20.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_a3dd7b8506a10785e037376dce2d0e20.jpg not downloaded yet
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_93f967ab82dc75483bc5cb4345855a13.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_93f967ab82dc75483bc5cb4345855a13.jpg not downloaded yet
2026-03-20 10:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_8ec1e0344283f85a86aef49278268341.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:39 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ22754%27 HTTP/1.1" 200 None
2026-03-20 10:19:39 [auto1.nl] INFO: Scrape type for HZ22754: 2
2026-03-20 10:19:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12734071-41ca-5e61-ac85-b4a3e87b3a02 with identifier: HZ22754
2026-03-20 10:19:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12734071-41ca-5e61-ac85-b4a3e87b3a02 with scrape type 2
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12734071-41ca-5e61-ac85-b4a3e87b3a02 with scrape type 2
2026-03-20 10:19:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 12734071-41ca-5e61-ac85-b4a3e87b3a02, identifier: HZ22754
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_65f4b7f0e92d1e7d02b307cfd2bc8654.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_65f4b7f0e92d1e7d02b307cfd2bc8654.jpg not downloaded yet
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_28f135371e1781d202f9b3b6ebeb4a6d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_28f135371e1781d202f9b3b6ebeb4a6d.jpg not downloaded yet
2026-03-20 10:19:39 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-20 10:19:39 [auto1.nl] INFO: Scrape type for HK41309: 2
2026-03-20 10:19:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-20 10:19:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with scrape type 2
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with scrape type 2
2026-03-20 10:19:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040, identifier: HK41309
2026-03-20 10:19:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d64b50>
2026-03-20 10:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_7c00663aa61d4f25b91185115c4a9679.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_7c00663aa61d4f25b91185115c4a9679.jpg saved to cache
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17
2026-03-20 10:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a19b90>
2026-03-20 10:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_9ca92ba3b3a36b96456d68eca1528c5c.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_9ca92ba3b3a36b96456d68eca1528c5c.jpg saved to cache
2026-03-20 10:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8476bd7c-64dc-568e-b34e-864910b5912d
2026-03-20 10:19:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 12734071-41ca-5e61-ac85-b4a3e87b3a02 with identifier: HZ22754
2026-03-20 10:19:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 12734071-41ca-5e61-ac85-b4a3e87b3a02 with identifier: HZ22754
2026-03-20 10:19:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 12734071-41ca-5e61-ac85-b4a3e87b3a02 with identifier: HZ22754 to the API
2026-03-20 10:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-21T16:21:11Z',
 'fuel_type': 'diesel',
 'id': '12734071-41ca-5e61-ac85-b4a3e87b3a02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ22754',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 58440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi GT L1',
 'transmission': 'manual',
 'trim': 'GT L1',
 'year': 2021}
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ22754%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [auto1.nl] INFO: Saving data for HZ22754: {'auction_closing_time': 1774110071.0, 'created_time': 1773133333.571338, 'last_price_update_time': 1774001980.120792}
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HZ22754') HTTP/1.1" 204 0
2026-03-20 10:19:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-20 10:19:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-20 10:19:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309 to the API
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-21T16:52:24Z',
 'fuel_type': 'petrol',
 'id': '5dc5bb30-2b38-5c98-8921-aa6df8ff1040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK41309',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 186806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-25',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [auto1.nl] INFO: Saving data for HK41309: {'auction_closing_time': 1774111944.0, 'created_time': 1773301820.159804, 'last_price_update_time': 1774001980.539758}
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK41309') HTTP/1.1" 204 0
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_e7041878fafc6c9e68bea2758874d79a.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_e7041878fafc6c9e68bea2758874d79a.jpg not downloaded yet
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_80c6d7febbee88923e3ff2f4cf6914a3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_80c6d7febbee88923e3ff2f4cf6914a3.jpg not downloaded yet
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_67e2f4d192b005b2e6a686eef5a78f7d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_67e2f4d192b005b2e6a686eef5a78f7d.jpg not downloaded yet
2026-03-20 10:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81bd4290>
2026-03-20 10:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_572d957f212db9a89578d03ab7e7cbd2.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_572d957f212db9a89578d03ab7e7cbd2.jpg saved to cache
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80dda890>
2026-03-20 10:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_50be1a00eaf266f88b979f43dab7688c.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_50be1a00eaf266f88b979f43dab7688c.jpg saved to cache
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:19:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f97ac31-2748-5a67-9214-311dd2f94c34 with identifier: EM54689
2026-03-20 10:19:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f97ac31-2748-5a67-9214-311dd2f94c34 with scrape type 1
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_775b005ce69f329e01a89d8de0c7a361.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_775b005ce69f329e01a89d8de0c7a361.jpg not downloaded yet
2026-03-20 10:19:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c with identifier: HA77445
2026-03-20 10:19:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c with scrape type 1
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa4%252F29a40865738edaa0279b9d2826ad7af5%252Fpa%252FHA77445_08d8a4744e8c26ae1cf3c56c7dbf90ab.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_08d8a4744e8c26ae1cf3c56c7dbf90ab.jpg already downloaded
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa4%252F29a40865738edaa0279b9d2826ad7af5%252Fpa%252FHA77445_2d059785a06452df2efc7c662bbb55f6.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_2d059785a06452df2efc7c662bbb55f6.jpg already downloaded
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa4%252F29a40865738edaa0279b9d2826ad7af5%252Fpa%252FHA77445_3de82621ba6c15018742217462b79e41.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_3de82621ba6c15018742217462b79e41.jpg already downloaded
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa4%252F29a40865738edaa0279b9d2826ad7af5%252Fpa%252FHA77445_244e587ff9600f497e1e07d673a45613.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_244e587ff9600f497e1e07d673a45613.jpg already downloaded
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa4%252F29a40865738edaa0279b9d2826ad7af5%252Fpa%252FHA77445_05c7c891716267ab92525840b67287a8.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_05c7c891716267ab92525840b67287a8.jpg already downloaded
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fa4%252F29a40865738edaa0279b9d2826ad7af5%252Fpa%252FHA77445_e3d928c805ba710728d0bb2a17fbebaa.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_e3d928c805ba710728d0bb2a17fbebaa.jpg already downloaded
2026-03-20 10:19:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c, identifier: HA77445
2026-03-20 10:19:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31ada58f-5c71-52e1-b827-972d132527b3 with identifier: KR30932
2026-03-20 10:19:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31ada58f-5c71-52e1-b827-972d132527b3 with scrape type 1
2026-03-20 10:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 31ada58f-5c71-52e1-b827-972d132527b3
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F30%252F8330967cda4b1580e91eafa4d3846a9f%252Fpa%252FKR30932_4d7ddd4dc4514c5ce2e18081af4e2ebe.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_4d7ddd4dc4514c5ce2e18081af4e2ebe.jpg already downloaded
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F30%252F8330967cda4b1580e91eafa4d3846a9f%252Fpa%252FKR30932_afd26442d7a1874de3d6acae03dfc66c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_afd26442d7a1874de3d6acae03dfc66c.jpg already downloaded
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F30%252F8330967cda4b1580e91eafa4d3846a9f%252Fpa%252FKR30932_f6107551a9dfacdb027576a23f2ad546.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_f6107551a9dfacdb027576a23f2ad546.jpg already downloaded
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F30%252F8330967cda4b1580e91eafa4d3846a9f%252Fpa%252FKR30932_f4a0beccda6c4c8f1afcbf756a7e67ee.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_f4a0beccda6c4c8f1afcbf756a7e67ee.jpg already downloaded
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F30%252F8330967cda4b1580e91eafa4d3846a9f%252Fpa%252FKR30932_8f38ffa794680f17e4857d4c78322851.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_8f38ffa794680f17e4857d4c78322851.jpg already downloaded
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F30%252F8330967cda4b1580e91eafa4d3846a9f%252Fpa%252FKR30932_d13d529fc8999624168b5844dd240720.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_d13d529fc8999624168b5844dd240720.jpg already downloaded
2026-03-20 10:19:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 31ada58f-5c71-52e1-b827-972d132527b3, identifier: KR30932
2026-03-20 10:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_c45e570ba623cbb516b80f8a870abef9.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_817e5ccaeb3c3f98722c457d63bb675e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_278e474fc4f25c2fd73f01707d265cb6.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_5f513a241aaa11942a47c468a92ec8f7.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_e0cb0a9031ae4de9e6e12d3f540781f0.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:41 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL96236%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [auto1.nl] INFO: Scrape type for ZL96236: 0
2026-03-20 10:19:41 [auto1.nl] INFO: Found listing with ID: TX65893
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TX65893%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [auto1.nl] INFO: Scrape type for TX65893: 0
2026-03-20 10:19:41 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-20 10:19:41 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [auto1.nl] INFO: Scrape type for HJ37238: 1
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_64c6f0e58ca0230dfc39134d5b0f01d3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_64c6f0e58ca0230dfc39134d5b0f01d3.jpg not downloaded yet
2026-03-20 10:19:41 [auto1.nl] INFO: Found listing with ID: UR05111
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR05111%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [auto1.nl] INFO: Scrape type for UR05111: 0
2026-03-20 10:19:41 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB43165%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [auto1.nl] INFO: Scrape type for MB43165: 2
2026-03-20 10:19:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165
2026-03-20 10:19:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with scrape type 2
2026-03-20 10:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with scrape type 2
2026-03-20 10:19:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b, identifier: MB43165
2026-03-20 10:19:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c with identifier: HA77445
2026-03-20 10:19:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c with identifier: HA77445
2026-03-20 10:19:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c with identifier: HA77445 to the API
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA77445>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-21T16:14:25Z',
 'fuel_type': 'petrol',
 'id': 'c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '99XRSF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA77445',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '3er',
 'odometer': 263811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_08d8a4744e8c26ae1cf3c56c7dbf90ab.jpg',
                'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_2d059785a06452df2efc7c662bbb55f6.jpg',
                'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_3de82621ba6c15018742217462b79e41.jpg',
                'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_244e587ff9600f497e1e07d673a45613.jpg',
                'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_05c7c891716267ab92525840b67287a8.jpg',
                'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_e3d928c805ba710728d0bb2a17fbebaa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c/c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_08d8a4744e8c26ae1cf3c56c7dbf90ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c/c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_2d059785a06452df2efc7c662bbb55f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c/c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_3de82621ba6c15018742217462b79e41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c/c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_244e587ff9600f497e1e07d673a45613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c/c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_05c7c891716267ab92525840b67287a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c/c8a345cd-f18e-5ec1-a8a2-59a26d0fb94c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/a4/29a40865738edaa0279b9d2826ad7af5/pa/HA77445_e3d928c805ba710728d0bb2a17fbebaa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA77445%27 HTTP/1.1" 200 None
2026-03-20 10:19:41 [auto1.nl] INFO: Saving data for HA77445: {'created_time': 1774001981.855717, 'last_price_update_time': 1774001981.855729, 'auction_closing_time': 1774109665.0}
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HA77445') HTTP/1.1" 204 0
2026-03-20 10:19:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 31ada58f-5c71-52e1-b827-972d132527b3 with identifier: KR30932
2026-03-20 10:19:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 31ada58f-5c71-52e1-b827-972d132527b3 with identifier: KR30932
2026-03-20 10:19:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 31ada58f-5c71-52e1-b827-972d132527b3 with identifier: KR30932 to the API
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KR30932>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-21T16:32:13Z',
 'fuel_type': 'petrol',
 'id': '31ada58f-5c71-52e1-b827-972d132527b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'Kj613d',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR30932',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 214086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_4d7ddd4dc4514c5ce2e18081af4e2ebe.jpg',
                'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_afd26442d7a1874de3d6acae03dfc66c.jpg',
                'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_f6107551a9dfacdb027576a23f2ad546.jpg',
                'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_f4a0beccda6c4c8f1afcbf756a7e67ee.jpg',
                'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_8f38ffa794680f17e4857d4c78322851.jpg',
                'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_d13d529fc8999624168b5844dd240720.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ada58f-5c71-52e1-b827-972d132527b3/31ada58f-5c71-52e1-b827-972d132527b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_4d7ddd4dc4514c5ce2e18081af4e2ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ada58f-5c71-52e1-b827-972d132527b3/31ada58f-5c71-52e1-b827-972d132527b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_afd26442d7a1874de3d6acae03dfc66c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ada58f-5c71-52e1-b827-972d132527b3/31ada58f-5c71-52e1-b827-972d132527b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_f6107551a9dfacdb027576a23f2ad546.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ada58f-5c71-52e1-b827-972d132527b3/31ada58f-5c71-52e1-b827-972d132527b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_f4a0beccda6c4c8f1afcbf756a7e67ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ada58f-5c71-52e1-b827-972d132527b3/31ada58f-5c71-52e1-b827-972d132527b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_8f38ffa794680f17e4857d4c78322851.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ada58f-5c71-52e1-b827-972d132527b3/31ada58f-5c71-52e1-b827-972d132527b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/30/8330967cda4b1580e91eafa4d3846a9f/pa/KR30932_d13d529fc8999624168b5844dd240720.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR30932%27 HTTP/1.1" 200 None
2026-03-20 10:19:42 [auto1.nl] INFO: Saving data for KR30932: {'created_time': 1774001982.307608, 'last_price_update_time': 1774001982.307621, 'auction_closing_time': 1774110733.0}
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KR30932') HTTP/1.1" 204 0
2026-03-20 10:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_ffca66c41e1de596b69fe3f5b3f68b67.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_fc0f7a66000594db012503d01326cd77.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165
2026-03-20 10:19:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165
2026-03-20 10:19:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165 to the API
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-21T16:44:37Z',
 'fuel_type': 'petrol',
 'id': '2b9d4aa4-afb0-5498-bbf7-0efe1853157b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB43165',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 57566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB43165%27 HTTP/1.1" 200 None
2026-03-20 10:19:42 [auto1.nl] INFO: Saving data for MB43165: {'auction_closing_time': 1774111477.0, 'created_time': 1773688230.871423, 'last_price_update_time': 1774001982.669969}
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB43165') HTTP/1.1" 204 0
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_4d42a37df0bfcdd736b2a3d4c31a47f3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_4d42a37df0bfcdd736b2a3d4c31a47f3.jpg not downloaded yet
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_c686e840de4c1f5fccf6f71206c1595e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_c686e840de4c1f5fccf6f71206c1595e.jpg not downloaded yet
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_257baf5fbef33dba8467f9d3c81167c8.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_257baf5fbef33dba8467f9d3c81167c8.jpg not downloaded yet
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80debfd0>
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F4b%252F8e4b7c2562cb0768f852a6956d1622dd%252Fpa%252FDK51587_8763059cfcbbbf3fe5711d3da757c869.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_8763059cfcbbbf3fe5711d3da757c869.jpg saved to cache
2026-03-20 10:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17
2026-03-20 10:19:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8789a205-9e07-534c-9e92-0e1a4f8a7d17, skipping ID generation
2026-03-20 10:19:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17 with scrape type 1
2026-03-20 10:19:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8789a205-9e07-534c-9e92-0e1a4f8a7d17 sending to next pipeline
2026-03-20 10:19:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8789a205-9e07-534c-9e92-0e1a4f8a7d17, identifier: DK51587
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f5ddd0>
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_ccc76ec9573434bdde75afa802b65c04.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_ccc76ec9573434bdde75afa802b65c04.jpg saved to cache
2026-03-20 10:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f43c90>
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg saved to cache
2026-03-20 10:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389
2026-03-20 10:19:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f67450>
2026-03-20 10:19:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_8ec1e0344283f85a86aef49278268341.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_8ec1e0344283f85a86aef49278268341.jpg saved to cache
2026-03-20 10:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f43db7c7-5211-573b-9ea1-2b34b361898b
2026-03-20 10:19:43 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-20 10:19:43 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-20 10:19:43 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD44915%27 HTTP/1.1" 200 None
2026-03-20 10:19:43 [auto1.nl] INFO: Scrape type for GD44915: 2
2026-03-20 10:19:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915
2026-03-20 10:19:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8687cf15-7688-575b-9acb-f780961e2d6b with scrape type 2
2026-03-20 10:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8687cf15-7688-575b-9acb-f780961e2d6b with scrape type 2
2026-03-20 10:19:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8687cf15-7688-575b-9acb-f780961e2d6b, identifier: GD44915
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_fc28b5af2603b29cda2568052655c1e4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_fc28b5af2603b29cda2568052655c1e4.jpg not downloaded yet
2026-03-20 10:19:43 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM27085%27 HTTP/1.1" 200 None
2026-03-20 10:19:43 [auto1.nl] INFO: Scrape type for DM27085: 0
2026-03-20 10:19:43 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW63639%27 HTTP/1.1" 200 None
2026-03-20 10:19:43 [auto1.nl] INFO: Scrape type for XW63639: 2
2026-03-20 10:19:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85fb2368-da53-5a87-9774-73213634643a with identifier: XW63639
2026-03-20 10:19:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85fb2368-da53-5a87-9774-73213634643a with scrape type 2
2026-03-20 10:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85fb2368-da53-5a87-9774-73213634643a with scrape type 2
2026-03-20 10:19:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 85fb2368-da53-5a87-9774-73213634643a, identifier: XW63639
2026-03-20 10:19:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8789a205-9e07-534c-9e92-0e1a4f8a7d17 with identifier: DK51587
2026-03-20 10:19:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8789a205-9e07-534c-9e92-0e1a4f8a7d17 with identifier: DK51587
2026-03-20 10:19:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8789a205-9e07-534c-9e92-0e1a4f8a7d17 with identifier: DK51587 to the API
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_8763059cfcbbbf3fe5711d3da757c869.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-21T16:51:49Z',
 'fuel_type': 'petrol',
 'id': '8789a205-9e07-534c-9e92-0e1a4f8a7d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '95SKL5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK51587',
 'listing': 'auction',
 'location': 'NL, Leiderdorp',
 'make': 'BMW',
 'model': '3er',
 'odometer': 365474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_ae2032405099f06f42a8d97907ed4812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_c24137d290b4e794b753ab0fc4f17f1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_105319b7220d83b40727c98982d42226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_7c00663aa61d4f25b91185115c4a9679.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_701da0767161b84ca18bc04f8b0be1e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8789a205-9e07-534c-9e92-0e1a4f8a7d17/8789a205-9e07-534c-9e92-0e1a4f8a7d17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/4b/8e4b7c2562cb0768f852a6956d1622dd/pa/DK51587_8763059cfcbbbf3fe5711d3da757c869.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK51587%27 HTTP/1.1" 200 None
2026-03-20 10:19:43 [auto1.nl] INFO: Saving data for DK51587: {'created_time': 1774001983.79173, 'last_price_update_time': 1774001983.791742, 'auction_closing_time': 1774111909.0}
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK51587') HTTP/1.1" 204 0
2026-03-20 10:19:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915
2026-03-20 10:19:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915
2026-03-20 10:19:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8687cf15-7688-575b-9acb-f780961e2d6b with identifier: GD44915 to the API
2026-03-20 10:19:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-21T16:47:40Z',
 'fuel_type': 'petrol',
 'id': '8687cf15-7688-575b-9acb-f780961e2d6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD44915',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 53894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-04',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2022}
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD44915%27 HTTP/1.1" 200 None
2026-03-20 10:19:44 [auto1.nl] INFO: Saving data for GD44915: {'auction_closing_time': 1774111660.0, 'created_time': 1773688343.670354, 'last_price_update_time': 1774001984.209429}
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD44915') HTTP/1.1" 204 0
2026-03-20 10:19:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 85fb2368-da53-5a87-9774-73213634643a with identifier: XW63639
2026-03-20 10:19:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 85fb2368-da53-5a87-9774-73213634643a with identifier: XW63639
2026-03-20 10:19:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 85fb2368-da53-5a87-9774-73213634643a with identifier: XW63639 to the API
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-21T16:53:50Z',
 'fuel_type': 'petrol',
 'id': '85fb2368-da53-5a87-9774-73213634643a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW63639',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 146439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-15',
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'M Sport Shadow',
 'year': 2019}
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW63639%27 HTTP/1.1" 200 None
2026-03-20 10:19:44 [auto1.nl] INFO: Saving data for XW63639: {'auction_closing_time': 1774112030.0, 'created_time': 1773688368.315368, 'last_price_update_time': 1774001984.714522}
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW63639') HTTP/1.1" 204 0
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_1fe2c8cff3db552c2ae1dcedb9f2f3c5.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_1fe2c8cff3db552c2ae1dcedb9f2f3c5.jpg not downloaded yet
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_fd94e6fa2c02f3f81559d26c8cf6b66a.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_fd94e6fa2c02f3f81559d26c8cf6b66a.jpg not downloaded yet
2026-03-20 10:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF13985> (referer: https://www.auto1.com/v1/car-details-view/EF13985/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b84ad0>
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_c45e570ba623cbb516b80f8a870abef9.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_c45e570ba623cbb516b80f8a870abef9.jpg saved to cache
2026-03-20 10:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8476bd7c-64dc-568e-b34e-864910b5912d
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f057d0>
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_817e5ccaeb3c3f98722c457d63bb675e.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_817e5ccaeb3c3f98722c457d63bb675e.jpg saved to cache
2026-03-20 10:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81bf64d0>
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_278e474fc4f25c2fd73f01707d265cb6.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_278e474fc4f25c2fd73f01707d265cb6.jpg saved to cache
2026-03-20 10:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81bf2d90>
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_5f513a241aaa11942a47c468a92ec8f7.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_5f513a241aaa11942a47c468a92ec8f7.jpg saved to cache
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8476bd7c-64dc-568e-b34e-864910b5912d
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80def250>
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_e0cb0a9031ae4de9e6e12d3f540781f0.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_e0cb0a9031ae4de9e6e12d3f540781f0.jpg saved to cache
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8476bd7c-64dc-568e-b34e-864910b5912d
2026-03-20 10:19:45 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE76328%27 HTTP/1.1" 200 None
2026-03-20 10:19:45 [auto1.nl] INFO: Scrape type for BE76328: 2
2026-03-20 10:19:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eba1053f-3ea5-5985-bb14-89f69274259b with identifier: BE76328
2026-03-20 10:19:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eba1053f-3ea5-5985-bb14-89f69274259b with scrape type 2
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eba1053f-3ea5-5985-bb14-89f69274259b with scrape type 2
2026-03-20 10:19:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eba1053f-3ea5-5985-bb14-89f69274259b, identifier: BE76328
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_caffe6e341acee001770bb88e9dfd9ab.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_caffe6e341acee001770bb88e9dfd9ab.jpg not downloaded yet
2026-03-20 10:19:45 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT16121%27 HTTP/1.1" 200 None
2026-03-20 10:19:45 [auto1.nl] INFO: Scrape type for YT16121: 2
2026-03-20 10:19:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc7c034c-da13-542a-8807-7edd9ad404dc with identifier: YT16121
2026-03-20 10:19:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7c034c-da13-542a-8807-7edd9ad404dc with scrape type 2
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc7c034c-da13-542a-8807-7edd9ad404dc with scrape type 2
2026-03-20 10:19:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dc7c034c-da13-542a-8807-7edd9ad404dc, identifier: YT16121
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83c3b6d0>
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_ffca66c41e1de596b69fe3f5b3f68b67.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_ffca66c41e1de596b69fe3f5b3f68b67.jpg saved to cache
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80ebff90>
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_fc0f7a66000594db012503d01326cd77.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_fc0f7a66000594db012503d01326cd77.jpg saved to cache
2026-03-20 10:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_775b005ce69f329e01a89d8de0c7a361.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_67e2f4d192b005b2e6a686eef5a78f7d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_f57d44d3e7a13b05a16d225c068af754.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_ac52f695424d19e3a33773640523178d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_8ed745d21d9fc9d16f96304433931d29.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_34284e276c944f609bbb540beac07a20.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eba1053f-3ea5-5985-bb14-89f69274259b with identifier: BE76328
2026-03-20 10:19:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eba1053f-3ea5-5985-bb14-89f69274259b with identifier: BE76328
2026-03-20 10:19:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eba1053f-3ea5-5985-bb14-89f69274259b with identifier: BE76328 to the API
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-21T16:50:55Z',
 'fuel_type': 'hybrid',
 'id': 'eba1053f-3ea5-5985-bb14-89f69274259b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE76328',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 172131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-08',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2015}
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE76328%27 HTTP/1.1" 200 None
2026-03-20 10:19:46 [auto1.nl] INFO: Saving data for BE76328: {'auction_closing_time': 1774111855.0, 'created_time': 1773132260.650484, 'last_price_update_time': 1774001986.093891}
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BE76328') HTTP/1.1" 204 0
2026-03-20 10:19:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dc7c034c-da13-542a-8807-7edd9ad404dc with identifier: YT16121
2026-03-20 10:19:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dc7c034c-da13-542a-8807-7edd9ad404dc with identifier: YT16121
2026-03-20 10:19:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dc7c034c-da13-542a-8807-7edd9ad404dc with identifier: YT16121 to the API
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-21T16:15:23Z',
 'fuel_type': 'petrol',
 'id': 'dc7c034c-da13-542a-8807-7edd9ad404dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT16121',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 253176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-20',
 'seller_name': None,
 'title': 'Citroen C4 2.0 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2005}
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT16121%27 HTTP/1.1" 200 None
2026-03-20 10:19:46 [auto1.nl] INFO: Saving data for YT16121: {'auction_closing_time': 1774109723.0, 'created_time': 1773687811.416298, 'last_price_update_time': 1774001986.552474}
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YT16121') HTTP/1.1" 204 0
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_d66933db1b6c68bd29219a2f0bf229f4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_d66933db1b6c68bd29219a2f0bf229f4.jpg not downloaded yet
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_dfe66c7268812162fa0ab1b5868d5f57.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_dfe66c7268812162fa0ab1b5868d5f57.jpg not downloaded yet
2026-03-20 10:19:46 [auto1.nl] INFO: Found listing with ID: CA44332
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA44332%27 HTTP/1.1" 200 None
2026-03-20 10:19:46 [auto1.nl] INFO: Scrape type for CA44332: 2
2026-03-20 10:19:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2e3bbf-ae99-5eaa-b78a-3f933b730114 with identifier: CA44332
2026-03-20 10:19:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2e3bbf-ae99-5eaa-b78a-3f933b730114 with scrape type 2
2026-03-20 10:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2e3bbf-ae99-5eaa-b78a-3f933b730114 with scrape type 2
2026-03-20 10:19:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2f2e3bbf-ae99-5eaa-b78a-3f933b730114, identifier: CA44332
2026-03-20 10:19:46 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF32327%27 HTTP/1.1" 200 None
2026-03-20 10:19:46 [auto1.nl] INFO: Scrape type for MF32327: 2
2026-03-20 10:19:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99d595f6-0392-5309-bc2e-9a41e4310ef3 with identifier: MF32327
2026-03-20 10:19:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99d595f6-0392-5309-bc2e-9a41e4310ef3 with scrape type 2
2026-03-20 10:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99d595f6-0392-5309-bc2e-9a41e4310ef3 with scrape type 2
2026-03-20 10:19:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99d595f6-0392-5309-bc2e-9a41e4310ef3, identifier: MF32327
2026-03-20 10:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dd64499-be69-5cf3-a582-237d1f997b11 with identifier: EF13985
2026-03-20 10:19:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dd64499-be69-5cf3-a582-237d1f997b11 with scrape type 1
2026-03-20 10:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_a04c15f3b522b97268998765f45a7784.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_a04c15f3b522b97268998765f45a7784.jpg not downloaded yet
2026-03-20 10:19:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2f2e3bbf-ae99-5eaa-b78a-3f933b730114 with identifier: CA44332
2026-03-20 10:19:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2f2e3bbf-ae99-5eaa-b78a-3f933b730114 with identifier: CA44332
2026-03-20 10:19:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2f2e3bbf-ae99-5eaa-b78a-3f933b730114 with identifier: CA44332 to the API
2026-03-20 10:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-21T16:20:51Z',
 'fuel_type': 'diesel',
 'id': '2f2e3bbf-ae99-5eaa-b78a-3f933b730114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA44332',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 182701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-24',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2014}
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA44332%27 HTTP/1.1" 200 None
2026-03-20 10:19:47 [auto1.nl] INFO: Saving data for CA44332: {'auction_closing_time': 1774110051.0, 'created_time': 1773688359.031852, 'last_price_update_time': 1774001987.296944}
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CA44332') HTTP/1.1" 204 0
2026-03-20 10:19:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99d595f6-0392-5309-bc2e-9a41e4310ef3 with identifier: MF32327
2026-03-20 10:19:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99d595f6-0392-5309-bc2e-9a41e4310ef3 with identifier: MF32327
2026-03-20 10:19:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99d595f6-0392-5309-bc2e-9a41e4310ef3 with identifier: MF32327 to the API
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-21T16:03:57Z',
 'fuel_type': 'diesel',
 'id': '99d595f6-0392-5309-bc2e-9a41e4310ef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF32327',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 159354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-03',
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2015}
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF32327%27 HTTP/1.1" 200 None
2026-03-20 10:19:47 [auto1.nl] INFO: Saving data for MF32327: {'auction_closing_time': 1774109037.0, 'created_time': 1773688306.249277, 'last_price_update_time': 1774001987.619492}
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MF32327') HTTP/1.1" 204 0
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_8233bc762aeddea5a8160c46ce8205c5.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_8233bc762aeddea5a8160c46ce8205c5.jpg not downloaded yet
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_2637087ae020e01b7e04bd47f6ac9d15.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_2637087ae020e01b7e04bd47f6ac9d15.jpg not downloaded yet
2026-03-20 10:19:47 [auto1.nl] INFO: Found listing with ID: SE16356
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE16356%27 HTTP/1.1" 200 None
2026-03-20 10:19:47 [auto1.nl] INFO: Scrape type for SE16356: 2
2026-03-20 10:19:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221e6d18-c6c1-52e1-b660-2d8df0724a5d with identifier: SE16356
2026-03-20 10:19:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221e6d18-c6c1-52e1-b660-2d8df0724a5d with scrape type 2
2026-03-20 10:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 221e6d18-c6c1-52e1-b660-2d8df0724a5d with scrape type 2
2026-03-20 10:19:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 221e6d18-c6c1-52e1-b660-2d8df0724a5d, identifier: SE16356
2026-03-20 10:19:47 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG22704%27 HTTP/1.1" 200 None
2026-03-20 10:19:47 [auto1.nl] INFO: Scrape type for ZG22704: 2
2026-03-20 10:19:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87738d86-3b55-5fb2-973b-b6da449cf699 with identifier: ZG22704
2026-03-20 10:19:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87738d86-3b55-5fb2-973b-b6da449cf699 with scrape type 2
2026-03-20 10:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87738d86-3b55-5fb2-973b-b6da449cf699 with scrape type 2
2026-03-20 10:19:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 87738d86-3b55-5fb2-973b-b6da449cf699, identifier: ZG22704
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_375aa1658e513f71257e69f4beef1759.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_375aa1658e513f71257e69f4beef1759.jpg not downloaded yet
2026-03-20 10:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD99814> (referer: https://www.auto1.com/v1/car-details-view/RD99814/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_93f967ab82dc75483bc5cb4345855a13.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 221e6d18-c6c1-52e1-b660-2d8df0724a5d with identifier: SE16356
2026-03-20 10:19:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 221e6d18-c6c1-52e1-b660-2d8df0724a5d with identifier: SE16356
2026-03-20 10:19:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 221e6d18-c6c1-52e1-b660-2d8df0724a5d with identifier: SE16356 to the API
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-21T16:49:51Z',
 'fuel_type': 'petrol',
 'id': '221e6d18-c6c1-52e1-b660-2d8df0724a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE16356',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 190594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-01',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE16356%27 HTTP/1.1" 200 None
2026-03-20 10:19:48 [auto1.nl] INFO: Saving data for SE16356: {'auction_closing_time': 1774111791.0, 'created_time': 1773302311.656093, 'last_price_update_time': 1774001988.292689}
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE16356') HTTP/1.1" 204 0
2026-03-20 10:19:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 87738d86-3b55-5fb2-973b-b6da449cf699 with identifier: ZG22704
2026-03-20 10:19:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 87738d86-3b55-5fb2-973b-b6da449cf699 with identifier: ZG22704
2026-03-20 10:19:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 87738d86-3b55-5fb2-973b-b6da449cf699 with identifier: ZG22704 to the API
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-21T16:32:54Z',
 'fuel_type': 'petrol',
 'id': '87738d86-3b55-5fb2-973b-b6da449cf699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG22704',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 207347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-15',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2015}
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG22704%27 HTTP/1.1" 200 None
2026-03-20 10:19:48 [auto1.nl] INFO: Saving data for ZG22704: {'auction_closing_time': 1774110774.0, 'created_time': 1773302378.931532, 'last_price_update_time': 1774001988.662981}
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG22704') HTTP/1.1" 204 0
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_b820c7c909656ce02f86cf9b02ef5b52.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_b820c7c909656ce02f86cf9b02ef5b52.jpg not downloaded yet
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_16f5138db42b0e3abd11f1a9c1f9ca49.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_16f5138db42b0e3abd11f1a9c1f9ca49.jpg not downloaded yet
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e48910>
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_775b005ce69f329e01a89d8de0c7a361.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_775b005ce69f329e01a89d8de0c7a361.jpg saved to cache
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81093b50>
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_67e2f4d192b005b2e6a686eef5a78f7d.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_67e2f4d192b005b2e6a686eef5a78f7d.jpg saved to cache
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e6c750>
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_f57d44d3e7a13b05a16d225c068af754.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_f57d44d3e7a13b05a16d225c068af754.jpg saved to cache
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f43db7c7-5211-573b-9ea1-2b34b361898b
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e7c510>
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_ac52f695424d19e3a33773640523178d.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_ac52f695424d19e3a33773640523178d.jpg saved to cache
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f43db7c7-5211-573b-9ea1-2b34b361898b
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e6e010>
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_8ed745d21d9fc9d16f96304433931d29.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_8ed745d21d9fc9d16f96304433931d29.jpg saved to cache
2026-03-20 10:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e50690>
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F49%252F4c49632f3a018170ece66b8746da57fc%252Fpa%252FTC74533_34284e276c944f609bbb540beac07a20.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_34284e276c944f609bbb540beac07a20.jpg saved to cache
2026-03-20 10:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8476bd7c-64dc-568e-b34e-864910b5912d
2026-03-20 10:19:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8476bd7c-64dc-568e-b34e-864910b5912d, skipping ID generation
2026-03-20 10:19:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8476bd7c-64dc-568e-b34e-864910b5912d with scrape type 1
2026-03-20 10:19:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8476bd7c-64dc-568e-b34e-864910b5912d sending to next pipeline
2026-03-20 10:19:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8476bd7c-64dc-568e-b34e-864910b5912d, identifier: TC74533
2026-03-20 10:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_28f135371e1781d202f9b3b6ebeb4a6d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_65f4b7f0e92d1e7d02b307cfd2bc8654.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_e7041878fafc6c9e68bea2758874d79a.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_fc28b5af2603b29cda2568052655c1e4.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_80c6d7febbee88923e3ff2f4cf6914a3.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:49 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL32110%27 HTTP/1.1" 200 None
2026-03-20 10:19:49 [auto1.nl] INFO: Scrape type for TL32110: 0
2026-03-20 10:19:49 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX67409%27 HTTP/1.1" 200 None
2026-03-20 10:19:49 [auto1.nl] INFO: Scrape type for JX67409: 0
2026-03-20 10:19:49 [auto1.nl] INFO: Found listing with ID: ZF00189
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZF00189%27 HTTP/1.1" 200 None
2026-03-20 10:19:49 [auto1.nl] INFO: Scrape type for ZF00189: 2
2026-03-20 10:19:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00e5accf-88fa-5ff3-95d6-fca68d4ddbec with identifier: ZF00189
2026-03-20 10:19:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00e5accf-88fa-5ff3-95d6-fca68d4ddbec with scrape type 2
2026-03-20 10:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00e5accf-88fa-5ff3-95d6-fca68d4ddbec with scrape type 2
2026-03-20 10:19:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 00e5accf-88fa-5ff3-95d6-fca68d4ddbec, identifier: ZF00189
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_98e3308d2035613f59aa76df0a191328.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_98e3308d2035613f59aa76df0a191328.jpg not downloaded yet
2026-03-20 10:19:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8476bd7c-64dc-568e-b34e-864910b5912d with identifier: TC74533
2026-03-20 10:19:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8476bd7c-64dc-568e-b34e-864910b5912d with identifier: TC74533
2026-03-20 10:19:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8476bd7c-64dc-568e-b34e-864910b5912d with identifier: TC74533 to the API
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_34284e276c944f609bbb540beac07a20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-21T16:45:17Z',
 'fuel_type': 'petrol',
 'id': '8476bd7c-64dc-568e-b34e-864910b5912d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '13GLL9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC74533',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 253187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_9ca92ba3b3a36b96456d68eca1528c5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_5f513a241aaa11942a47c468a92ec8f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_e0cb0a9031ae4de9e6e12d3f540781f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_c45e570ba623cbb516b80f8a870abef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8476bd7c-64dc-568e-b34e-864910b5912d/8476bd7c-64dc-568e-b34e-864910b5912d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/49/4c49632f3a018170ece66b8746da57fc/pa/TC74533_34284e276c944f609bbb540beac07a20.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2008}
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC74533%27 HTTP/1.1" 200 None
2026-03-20 10:19:49 [auto1.nl] INFO: Saving data for TC74533: {'created_time': 1774001989.703544, 'last_price_update_time': 1774001989.703555, 'auction_closing_time': 1774111517.0}
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC74533') HTTP/1.1" 204 0
2026-03-20 10:19:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 00e5accf-88fa-5ff3-95d6-fca68d4ddbec with identifier: ZF00189
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-20 10:19:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 00e5accf-88fa-5ff3-95d6-fca68d4ddbec with identifier: ZF00189
2026-03-20 10:19:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 00e5accf-88fa-5ff3-95d6-fca68d4ddbec with identifier: ZF00189 to the API
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-21T16:04:57Z',
 'fuel_type': 'petrol',
 'id': '00e5accf-88fa-5ff3-95d6-fca68d4ddbec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF00189',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 147346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-04',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2014}
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZF00189%27 HTTP/1.1" 200 None
2026-03-20 10:19:50 [auto1.nl] INFO: Saving data for ZF00189: {'auction_closing_time': 1774109097.0, 'created_time': 1773687805.216728, 'last_price_update_time': 1774001990.315812}
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZF00189') HTTP/1.1" 204 0
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_b31dece6ecf363f3449e5c0944780f6f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_b31dece6ecf363f3449e5c0944780f6f.jpg not downloaded yet
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_3ff5351543623d42824b74d89078bcef.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_3ff5351543623d42824b74d89078bcef.jpg not downloaded yet
2026-03-20 10:19:50 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 1055 | hits on page: 40
2026-03-20 10:19:50 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-20 10:19:50 [auto1.nl] INFO: Scrape type for CT54062: 2
2026-03-20 10:19:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-20 10:19:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1158f01-7d72-5e4e-a742-1f164b3c10f0 with scrape type 2
2026-03-20 10:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1158f01-7d72-5e4e-a742-1f164b3c10f0 with scrape type 2
2026-03-20 10:19:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1158f01-7d72-5e4e-a742-1f164b3c10f0, identifier: CT54062
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_649ea837b573d740925f76558c9ba711.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_649ea837b573d740925f76558c9ba711.jpg not downloaded yet
2026-03-20 10:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_caffe6e341acee001770bb88e9dfd9ab.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-20 10:19:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:19:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062
2026-03-20 10:19:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1158f01-7d72-5e4e-a742-1f164b3c10f0 with identifier: CT54062 to the API
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-21T16:05:25Z',
 'fuel_type': 'petrol',
 'id': 'c1158f01-7d72-5e4e-a742-1f164b3c10f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT54062',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 25088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-09',
 'seller_name': None,
 'title': 'MINI Countryman Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2023}
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-20 10:19:51 [auto1.nl] INFO: Saving data for CT54062: {'auction_closing_time': 1774109125.0, 'created_time': 1773232326.734161, 'last_price_update_time': 1774001991.081341}
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT54062') HTTP/1.1" 204 0
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_972a6f9be475c943437df79b96333d14.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_972a6f9be475c943437df79b96333d14.jpg not downloaded yet
2026-03-20 10:19:51 [auto1.nl] INFO: Found listing with ID: ML02089
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML02089%27 HTTP/1.1" 200 None
2026-03-20 10:19:51 [auto1.nl] INFO: Scrape type for ML02089: 1
2026-03-20 10:19:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d651fd-f40e-542e-a51b-70669b5aace5 with identifier: RD99814
2026-03-20 10:19:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d651fd-f40e-542e-a51b-70669b5aace5 with scrape type 1
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67d651fd-f40e-542e-a51b-70669b5aace5
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_5033cbea8c239a1d37e86b9e7fae7ae4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5033cbea8c239a1d37e86b9e7fae7ae4.jpg already downloaded
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg not downloaded yet
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e6d890>
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_93f967ab82dc75483bc5cb4345855a13.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_93f967ab82dc75483bc5cb4345855a13.jpg saved to cache
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e0df50>
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_28f135371e1781d202f9b3b6ebeb4a6d.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_28f135371e1781d202f9b3b6ebeb4a6d.jpg saved to cache
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8102f650>
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_65f4b7f0e92d1e7d02b307cfd2bc8654.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_65f4b7f0e92d1e7d02b307cfd2bc8654.jpg saved to cache
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e78590>
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_e7041878fafc6c9e68bea2758874d79a.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_e7041878fafc6c9e68bea2758874d79a.jpg saved to cache
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81035290>
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_fc28b5af2603b29cda2568052655c1e4.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_fc28b5af2603b29cda2568052655c1e4.jpg saved to cache
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83d4f710>
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_80c6d7febbee88923e3ff2f4cf6914a3.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_80c6d7febbee88923e3ff2f4cf6914a3.jpg saved to cache
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f43db7c7-5211-573b-9ea1-2b34b361898b
2026-03-20 10:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_fd94e6fa2c02f3f81559d26c8cf6b66a.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_c686e840de4c1f5fccf6f71206c1595e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:51 [auto1.nl] INFO: Found listing with ID: PL05358
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL05358%27 HTTP/1.1" 200 None
2026-03-20 10:19:51 [auto1.nl] INFO: Scrape type for PL05358: 2
2026-03-20 10:19:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73130763-47f6-5048-9af0-2641c1283ad7 with identifier: PL05358
2026-03-20 10:19:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73130763-47f6-5048-9af0-2641c1283ad7 with scrape type 2
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73130763-47f6-5048-9af0-2641c1283ad7 with scrape type 2
2026-03-20 10:19:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 73130763-47f6-5048-9af0-2641c1283ad7, identifier: PL05358
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_d703f399fe185b6e153bc5d6a08ab126.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_d703f399fe185b6e153bc5d6a08ab126.jpg not downloaded yet
2026-03-20 10:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_1fe2c8cff3db552c2ae1dcedb9f2f3c5.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_257baf5fbef33dba8467f9d3c81167c8.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_4d42a37df0bfcdd736b2a3d4c31a47f3.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 73130763-47f6-5048-9af0-2641c1283ad7 with identifier: PL05358
2026-03-20 10:19:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 73130763-47f6-5048-9af0-2641c1283ad7 with identifier: PL05358
2026-03-20 10:19:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 73130763-47f6-5048-9af0-2641c1283ad7 with identifier: PL05358 to the API
2026-03-20 10:19:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-21T16:44:06Z',
 'fuel_type': 'petrol',
 'id': '73130763-47f6-5048-9af0-2641c1283ad7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL05358',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 71964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL05358%27 HTTP/1.1" 200 None
2026-03-20 10:19:52 [auto1.nl] INFO: Saving data for PL05358: {'auction_closing_time': 1774111446.0, 'created_time': 1773688682.164466, 'last_price_update_time': 1774001992.134756}
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PL05358') HTTP/1.1" 204 0
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_1ac708278a1665ef1673502019ac3d2f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_1ac708278a1665ef1673502019ac3d2f.jpg not downloaded yet
2026-03-20 10:19:52 [auto1.nl] INFO: Found listing with ID: CF94302
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF94302%27 HTTP/1.1" 200 None
2026-03-20 10:19:52 [auto1.nl] INFO: Scrape type for CF94302: 1
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_c90ad227d816ab77dc44601bc53841d0.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_c90ad227d816ab77dc44601bc53841d0.jpg not downloaded yet
2026-03-20 10:19:52 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW17095%27 HTTP/1.1" 200 None
2026-03-20 10:19:52 [auto1.nl] INFO: Scrape type for XW17095: 2
2026-03-20 10:19:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095
2026-03-20 10:19:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d78efdc7-bf27-5ebc-b817-2318bf5d29bf with scrape type 2
2026-03-20 10:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d78efdc7-bf27-5ebc-b817-2318bf5d29bf with scrape type 2
2026-03-20 10:19:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d78efdc7-bf27-5ebc-b817-2318bf5d29bf, identifier: XW17095
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_5990fc7da82c7225df52f7f6771cb1b0.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_5990fc7da82c7225df52f7f6771cb1b0.jpg not downloaded yet
2026-03-20 10:19:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e48450>
2026-03-20 10:19:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_caffe6e341acee001770bb88e9dfd9ab.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_caffe6e341acee001770bb88e9dfd9ab.jpg saved to cache
2026-03-20 10:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_2637087ae020e01b7e04bd47f6ac9d15.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_dfe66c7268812162fa0ab1b5868d5f57.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095
2026-03-20 10:19:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095
2026-03-20 10:19:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d78efdc7-bf27-5ebc-b817-2318bf5d29bf with identifier: XW17095 to the API
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-21T16:22:07Z',
 'fuel_type': 'petrol',
 'id': 'd78efdc7-bf27-5ebc-b817-2318bf5d29bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW17095',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 56194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW17095%27 HTTP/1.1" 200 None
2026-03-20 10:19:52 [auto1.nl] INFO: Saving data for XW17095: {'auction_closing_time': 1774110127.0, 'created_time': 1773688538.711693, 'last_price_update_time': 1774001992.948892}
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW17095') HTTP/1.1" 204 0
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_2c3957ad3cfd2aee13b29205ce9cb40e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_2c3957ad3cfd2aee13b29205ce9cb40e.jpg not downloaded yet
2026-03-20 10:19:52 [auto1.nl] INFO: Found listing with ID: WF53810
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF53810%27 HTTP/1.1" 200 None
2026-03-20 10:19:53 [auto1.nl] INFO: Scrape type for WF53810: 1
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg not downloaded yet
2026-03-20 10:19:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_8233bc762aeddea5a8160c46ce8205c5.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:53 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF50619%27 HTTP/1.1" 200 None
2026-03-20 10:19:53 [auto1.nl] INFO: Scrape type for BF50619: 2
2026-03-20 10:19:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 879190fb-07e0-5193-a255-659073128779 with identifier: BF50619
2026-03-20 10:19:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 879190fb-07e0-5193-a255-659073128779 with scrape type 2
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 879190fb-07e0-5193-a255-659073128779 with scrape type 2
2026-03-20 10:19:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 879190fb-07e0-5193-a255-659073128779, identifier: BF50619
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_b6199bdf24207c6e40a85bbaaee9fc57.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_b6199bdf24207c6e40a85bbaaee9fc57.jpg not downloaded yet
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f6b110>
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_fd94e6fa2c02f3f81559d26c8cf6b66a.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_fd94e6fa2c02f3f81559d26c8cf6b66a.jpg saved to cache
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf819a9d90>
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_c686e840de4c1f5fccf6f71206c1595e.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_c686e840de4c1f5fccf6f71206c1595e.jpg saved to cache
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c2fc10>
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_1fe2c8cff3db552c2ae1dcedb9f2f3c5.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_1fe2c8cff3db552c2ae1dcedb9f2f3c5.jpg saved to cache
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8108ac50>
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_257baf5fbef33dba8467f9d3c81167c8.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_257baf5fbef33dba8467f9d3c81167c8.jpg saved to cache
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80fb6b10>
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_4d42a37df0bfcdd736b2a3d4c31a47f3.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_4d42a37df0bfcdd736b2a3d4c31a47f3.jpg saved to cache
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f43db7c7-5211-573b-9ea1-2b34b361898b
2026-03-20 10:19:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 879190fb-07e0-5193-a255-659073128779 with identifier: BF50619
2026-03-20 10:19:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 879190fb-07e0-5193-a255-659073128779 with identifier: BF50619
2026-03-20 10:19:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 879190fb-07e0-5193-a255-659073128779 with identifier: BF50619 to the API
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-21T16:39:10Z',
 'fuel_type': 'diesel',
 'id': '879190fb-07e0-5193-a255-659073128779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF50619',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 301709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-06',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2016}
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF50619%27 HTTP/1.1" 200 None
2026-03-20 10:19:53 [auto1.nl] INFO: Saving data for BF50619: {'auction_closing_time': 1774111150.0, 'created_time': 1773688416.211635, 'last_price_update_time': 1774001993.889074}
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BF50619') HTTP/1.1" 204 0
2026-03-20 10:19:53 [auto1.nl] INFO: Found listing with ID: NB80736
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB80736%27 HTTP/1.1" 200 None
2026-03-20 10:19:53 [auto1.nl] INFO: Scrape type for NB80736: 1
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg not downloaded yet
2026-03-20 10:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_51f2d1ffd83d861d0968c7a134be24a8.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_d66933db1b6c68bd29219a2f0bf229f4.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_16f5138db42b0e3abd11f1a9c1f9ca49.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_375aa1658e513f71257e69f4beef1759.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_b820c7c909656ce02f86cf9b02ef5b52.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:53 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-20 10:19:53 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-20 10:19:53 [auto1.nl] INFO: Found listing with ID: WN42867
2026-03-20 10:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN42867%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for WN42867: 2
2026-03-20 10:19:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bba0c3d4-80d4-5eba-b6eb-81cd859bfbb5 with identifier: WN42867
2026-03-20 10:19:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bba0c3d4-80d4-5eba-b6eb-81cd859bfbb5 with scrape type 2
2026-03-20 10:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bba0c3d4-80d4-5eba-b6eb-81cd859bfbb5 with scrape type 2
2026-03-20 10:19:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bba0c3d4-80d4-5eba-b6eb-81cd859bfbb5, identifier: WN42867
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_6fe6483d7e2239e90844903c51cc978d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_6fe6483d7e2239e90844903c51cc978d.jpg not downloaded yet
2026-03-20 10:19:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_649ea837b573d740925f76558c9ba711.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bba0c3d4-80d4-5eba-b6eb-81cd859bfbb5 with identifier: WN42867
2026-03-20 10:19:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bba0c3d4-80d4-5eba-b6eb-81cd859bfbb5 with identifier: WN42867
2026-03-20 10:19:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bba0c3d4-80d4-5eba-b6eb-81cd859bfbb5 with identifier: WN42867 to the API
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-21T16:12:51Z',
 'fuel_type': 'hybrid',
 'id': 'bba0c3d4-80d4-5eba-b6eb-81cd859bfbb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN42867',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 58723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN42867%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Saving data for WN42867: {'auction_closing_time': 1774109571.0, 'created_time': 1773134519.256732, 'last_price_update_time': 1774001994.552568}
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN42867') HTTP/1.1" 204 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: HB04792
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB04792%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for HB04792: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE91435%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for FE91435: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for YN95467: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: XX98874
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XX98874%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for XX98874: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: WB25150
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WB25150%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for WB25150: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: NS54863
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS54863%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for NS54863: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: CJ08263
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ08263%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for CJ08263: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: FS28745
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS28745%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for FS28745: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: JD02272
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD02272%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for JD02272: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: VK37076
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK37076%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for VK37076: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: RJ35117
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ35117%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for RJ35117: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: GM91378
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM91378%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for GM91378: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: CU46217
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU46217%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for CU46217: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: LX15335
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX15335%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for LX15335: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: ZE62663
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE62663%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for ZE62663: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: DD20442
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD20442%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for DD20442: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: GC07226
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC07226%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for GC07226: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: ZV80842
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZV80842%27 HTTP/1.1" 200 None
2026-03-20 10:19:54 [auto1.nl] INFO: Scrape type for ZV80842: 0
2026-03-20 10:19:54 [auto1.nl] INFO: Found listing with ID: FM30730
2026-03-20 10:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM30730%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for FM30730: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: YL34275
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YL34275%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for YL34275: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: UB92194
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB92194%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for UB92194: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: BB89818
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB89818%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for BB89818: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM68754%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for GM68754: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: VK01121
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK01121%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for VK01121: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: KN36141
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KN36141%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for KN36141: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: LA89986
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA89986%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for LA89986: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: NZ25239
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ25239%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for NZ25239: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: YR13587
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR13587%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for YR13587: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET91545%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for ET91545: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: AC58104
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC58104%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for AC58104: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: HA32724
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA32724%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for HA32724: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: XX54002
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XX54002%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for XX54002: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: VF74605
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF74605%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for VF74605: 0
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: MR65876
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR65876%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for MR65876: 0
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_5095648057ea9c5932d475322f7e914f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5095648057ea9c5932d475322f7e914f.jpg not downloaded yet
2026-03-20 10:19:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f16950>
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_2637087ae020e01b7e04bd47f6ac9d15.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_2637087ae020e01b7e04bd47f6ac9d15.jpg saved to cache
2026-03-20 10:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d74810>
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_dfe66c7268812162fa0ab1b5868d5f57.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_dfe66c7268812162fa0ab1b5868d5f57.jpg saved to cache
2026-03-20 10:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8104d590>
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_8233bc762aeddea5a8160c46ce8205c5.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_8233bc762aeddea5a8160c46ce8205c5.jpg saved to cache
2026-03-20 10:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:55 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [auto1.nl] INFO: Scrape type for SX35832: 2
2026-03-20 10:19:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832
2026-03-20 10:19:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5327012-ac9e-578d-8d90-156cca28f9cd with scrape type 2
2026-03-20 10:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5327012-ac9e-578d-8d90-156cca28f9cd with scrape type 2
2026-03-20 10:19:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5327012-ac9e-578d-8d90-156cca28f9cd, identifier: SX35832
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_d805db81398895aaf5acbc4bb5413d69.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_d805db81398895aaf5acbc4bb5413d69.jpg not downloaded yet
2026-03-20 10:19:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832
2026-03-20 10:19:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832
2026-03-20 10:19:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5327012-ac9e-578d-8d90-156cca28f9cd with identifier: SX35832 to the API
2026-03-20 10:19:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-21T16:41:01Z',
 'fuel_type': 'petrol',
 'id': 'f5327012-ac9e-578d-8d90-156cca28f9cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX35832',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 179932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-21',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2009}
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-20 10:19:56 [auto1.nl] INFO: Saving data for SX35832: {'auction_closing_time': 1774111261.0, 'created_time': 1773229554.129226, 'last_price_update_time': 1774001996.249216}
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SX35832') HTTP/1.1" 204 0
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_7520498530dede93d9186f2e2c6fa280.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_7520498530dede93d9186f2e2c6fa280.jpg already downloaded
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_9e1600f1acc61d1fc596c0c62c6568bf.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_9e1600f1acc61d1fc596c0c62c6568bf.jpg already downloaded
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_6415a33a935137f0c3d8d0ac7394171e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_6415a33a935137f0c3d8d0ac7394171e.jpg already downloaded
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_1f855b1de1b25043bcd49d26d2e5af0b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_1f855b1de1b25043bcd49d26d2e5af0b.jpg already downloaded
2026-03-20 10:19:56 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-20 10:19:56 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-20 10:19:56 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-20 10:19:56 [auto1.nl] INFO: Scrape type for NR59954: 2
2026-03-20 10:19:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-20 10:19:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a57a418-7494-5caa-99bb-22f2e88a16d7 with scrape type 2
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a57a418-7494-5caa-99bb-22f2e88a16d7 with scrape type 2
2026-03-20 10:19:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a57a418-7494-5caa-99bb-22f2e88a16d7, identifier: NR59954
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_4940f773fc49f83aef11ae5cb05cb0ff.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_4940f773fc49f83aef11ae5cb05cb0ff.jpg not downloaded yet
2026-03-20 10:19:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-20 10:19:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-20 10:19:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-20 10:19:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-20 10:19:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81baa390>
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_51f2d1ffd83d861d0968c7a134be24a8.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_51f2d1ffd83d861d0968c7a134be24a8.jpg saved to cache
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d5cf90>
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_d66933db1b6c68bd29219a2f0bf229f4.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_d66933db1b6c68bd29219a2f0bf229f4.jpg saved to cache
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8108a050>
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_16f5138db42b0e3abd11f1a9c1f9ca49.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_16f5138db42b0e3abd11f1a9c1f9ca49.jpg saved to cache
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e52990>
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_375aa1658e513f71257e69f4beef1759.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_375aa1658e513f71257e69f4beef1759.jpg saved to cache
2026-03-20 10:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80fa4990>
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_b820c7c909656ce02f86cf9b02ef5b52.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_b820c7c909656ce02f86cf9b02ef5b52.jpg saved to cache
2026-03-20 10:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d7b310>
2026-03-20 10:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_649ea837b573d740925f76558c9ba711.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_649ea837b573d740925f76558c9ba711.jpg saved to cache
2026-03-20 10:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_3ff5351543623d42824b74d89078bcef.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_5990fc7da82c7225df52f7f6771cb1b0.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-20 10:19:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954
2026-03-20 10:19:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a57a418-7494-5caa-99bb-22f2e88a16d7 with identifier: NR59954 to the API
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-21T16:38:42Z',
 'fuel_type': 'petrol',
 'id': '8a57a418-7494-5caa-99bb-22f2e88a16d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR59954',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 319215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': None,
 'title': 'Volvo V70 1.6 T4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2012}
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-20 10:19:57 [auto1.nl] INFO: Saving data for NR59954: {'auction_closing_time': 1774111122.0, 'created_time': 1773232326.378528, 'last_price_update_time': 1774001997.446673}
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NR59954') HTTP/1.1" 204 0
2026-03-20 10:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_c90ad227d816ab77dc44601bc53841d0.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:57 [auto1.nl] INFO: Found listing with ID: LV76433
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LV76433%27 HTTP/1.1" 200 None
2026-03-20 10:19:57 [auto1.nl] INFO: Scrape type for LV76433: 0
2026-03-20 10:19:57 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX92385%27 HTTP/1.1" 200 None
2026-03-20 10:19:57 [auto1.nl] INFO: Scrape type for FX92385: 0
2026-03-20 10:19:57 [auto1.nl] INFO: Found listing with ID: BR41247
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR41247%27 HTTP/1.1" 200 None
2026-03-20 10:19:57 [auto1.nl] INFO: Scrape type for BR41247: 2
2026-03-20 10:19:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f46a58da-76f7-5aa4-bae1-33161424af04 with identifier: BR41247
2026-03-20 10:19:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f46a58da-76f7-5aa4-bae1-33161424af04 with scrape type 2
2026-03-20 10:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f46a58da-76f7-5aa4-bae1-33161424af04 with scrape type 2
2026-03-20 10:19:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f46a58da-76f7-5aa4-bae1-33161424af04, identifier: BR41247
2026-03-20 10:19:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f46a58da-76f7-5aa4-bae1-33161424af04 with identifier: BR41247
2026-03-20 10:19:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f46a58da-76f7-5aa4-bae1-33161424af04 with identifier: BR41247
2026-03-20 10:19:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f46a58da-76f7-5aa4-bae1-33161424af04 with identifier: BR41247 to the API
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-21T16:58:54Z',
 'fuel_type': 'petrol',
 'id': 'f46a58da-76f7-5aa4-bae1-33161424af04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR41247',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 328320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-17',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.8 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2007}
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR41247%27 HTTP/1.1" 200 None
2026-03-20 10:19:58 [auto1.nl] INFO: Saving data for BR41247: {'auction_closing_time': 1774112334.0, 'created_time': 1773688483.750964, 'last_price_update_time': 1774001998.014162}
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BR41247') HTTP/1.1" 204 0
2026-03-20 10:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML02089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_2c3957ad3cfd2aee13b29205ce9cb40e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:58 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-20 10:19:58 [auto1.nl] INFO: Scrape type for SA79399: 2
2026-03-20 10:19:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399
2026-03-20 10:19:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10916b17-6fe9-5b28-be65-3bd62aad6713 with scrape type 2
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10916b17-6fe9-5b28-be65-3bd62aad6713 with scrape type 2
2026-03-20 10:19:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 10916b17-6fe9-5b28-be65-3bd62aad6713, identifier: SA79399
2026-03-20 10:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF94302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c9f110>
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_3ff5351543623d42824b74d89078bcef.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_3ff5351543623d42824b74d89078bcef.jpg saved to cache
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80fc5bd0>
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg saved to cache
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67d651fd-f40e-542e-a51b-70669b5aace5
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80fe1bd0>
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_5990fc7da82c7225df52f7f6771cb1b0.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_5990fc7da82c7225df52f7f6771cb1b0.jpg saved to cache
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399
2026-03-20 10:19:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399
2026-03-20 10:19:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 10916b17-6fe9-5b28-be65-3bd62aad6713 with identifier: SA79399 to the API
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:19:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-21T16:18:30Z',
 'fuel_type': 'diesel',
 'id': '10916b17-6fe9-5b28-be65-3bd62aad6713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA79399',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 472851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-21',
 'seller_name': None,
 'title': 'Volvo V70 2.4 D Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2008}
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-20 10:19:58 [auto1.nl] INFO: Saving data for SA79399: {'auction_closing_time': 1774109910.0, 'created_time': 1773131915.949564, 'last_price_update_time': 1774001998.791237}
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA79399') HTTP/1.1" 204 0
2026-03-20 10:19:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf819b5b50>
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_c90ad227d816ab77dc44601bc53841d0.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_c90ad227d816ab77dc44601bc53841d0.jpg saved to cache
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67d651fd-f40e-542e-a51b-70669b5aace5
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83d4cad0>
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg saved to cache
2026-03-20 10:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67d651fd-f40e-542e-a51b-70669b5aace5
2026-03-20 10:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5095648057ea9c5932d475322f7e914f.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_d805db81398895aaf5acbc4bb5413d69.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:58 [auto1.nl] INFO: Found listing with ID: JR69435
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR69435%27 HTTP/1.1" 200 None
2026-03-20 10:19:58 [auto1.nl] INFO: Scrape type for JR69435: 1
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b73f50>
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_2c3957ad3cfd2aee13b29205ce9cb40e.jpg') HTTP/1.1" 204 0
2026-03-20 10:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_2c3957ad3cfd2aee13b29205ce9cb40e.jpg saved to cache
2026-03-20 10:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:19:59 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 1055 | hits on page: 40
2026-03-20 10:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_6fe6483d7e2239e90844903c51cc978d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: UL62250
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UL62250%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for UL62250: 1
2026-03-20 10:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF53810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:19:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA94129%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for EA94129: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: NX17950
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX17950%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for NX17950: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for EM54492: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for FE21861: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: BF62657
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF62657%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for BF62657: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: AB44579
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB44579%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for AB44579: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: TP82192
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP82192%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for TP82192: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: HF55140
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF55140%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for HF55140: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for RD50492: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for UF96545: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: JU63590
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JU63590%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for JU63590: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: XT12089
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XT12089%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for XT12089: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: NH87974
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH87974%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for NH87974: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for YH72796: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: WE35963
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE35963%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for WE35963: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: AE96402
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE96402%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for AE96402: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: DL76923
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL76923%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for DL76923: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for FH34143: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: XM79145
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM79145%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for XM79145: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: JX71171
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX71171%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for JX71171: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: BZ15848
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ15848%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for BZ15848: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV35318%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for DV35318: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for JX11008: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for SV01425: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: WE20497
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE20497%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for WE20497: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK39469%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for WK39469: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-20 10:19:59 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-20 10:19:59 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-20 10:20:00 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-20 10:20:00 [auto1.nl] INFO: Found listing with ID: JR48368
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR48368%27 HTTP/1.1" 200 None
2026-03-20 10:20:00 [auto1.nl] INFO: Scrape type for JR48368: 0
2026-03-20 10:20:00 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-20 10:20:00 [auto1.nl] INFO: Scrape type for CP77095: 0
2026-03-20 10:20:00 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-20 10:20:00 [auto1.nl] INFO: Scrape type for CJ41969: 0
2026-03-20 10:20:00 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP28763%27 HTTP/1.1" 200 None
2026-03-20 10:20:00 [auto1.nl] INFO: Scrape type for XP28763: 0
2026-03-20 10:20:00 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-20 10:20:00 [auto1.nl] INFO: Scrape type for RA23366: 0
2026-03-20 10:20:00 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-20 10:20:00 [auto1.nl] INFO: Scrape type for NJ80961: 0
2026-03-20 10:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB80736/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80dd6f90>
2026-03-20 10:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg saved to cache
2026-03-20 10:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67d651fd-f40e-542e-a51b-70669b5aace5
2026-03-20 10:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_1ac708278a1665ef1673502019ac3d2f.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:00 [auto1.nl] INFO: Found listing with ID: CX69054
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX69054%27 HTTP/1.1" 200 None
2026-03-20 10:20:00 [auto1.nl] INFO: Scrape type for CX69054: 2
2026-03-20 10:20:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32680a5b-4bcd-527e-a3fd-549a549fc492 with identifier: CX69054
2026-03-20 10:20:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32680a5b-4bcd-527e-a3fd-549a549fc492 with scrape type 2
2026-03-20 10:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32680a5b-4bcd-527e-a3fd-549a549fc492 with scrape type 2
2026-03-20 10:20:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32680a5b-4bcd-527e-a3fd-549a549fc492, identifier: CX69054
2026-03-20 10:20:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32680a5b-4bcd-527e-a3fd-549a549fc492 with identifier: CX69054
2026-03-20 10:20:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32680a5b-4bcd-527e-a3fd-549a549fc492 with identifier: CX69054
2026-03-20 10:20:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32680a5b-4bcd-527e-a3fd-549a549fc492 with identifier: CX69054 to the API
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-21T16:51:10Z',
 'fuel_type': 'diesel',
 'id': '32680a5b-4bcd-527e-a3fd-549a549fc492',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX69054',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 272143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-12',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2 Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2012}
2026-03-20 10:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX69054%27 HTTP/1.1" 200 None
2026-03-20 10:20:01 [auto1.nl] INFO: Saving data for CX69054: {'auction_closing_time': 1774111870.0, 'created_time': 1773342325.94568, 'last_price_update_time': 1774002001.00312}
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CX69054') HTTP/1.1" 204 0
2026-03-20 10:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_972a6f9be475c943437df79b96333d14.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_b31dece6ecf363f3449e5c0944780f6f.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:01 [auto1.nl] INFO: Found listing with ID: JS60646
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS60646%27 HTTP/1.1" 200 None
2026-03-20 10:20:01 [auto1.nl] INFO: Scrape type for JS60646: 1
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a0f2d0>
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F2a%252Fd02aa6ea0baaa84cf6d21544d12cbc36%252Fpa%252FRD99814_5095648057ea9c5932d475322f7e914f.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5095648057ea9c5932d475322f7e914f.jpg saved to cache
2026-03-20 10:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67d651fd-f40e-542e-a51b-70669b5aace5
2026-03-20 10:20:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67d651fd-f40e-542e-a51b-70669b5aace5, skipping ID generation
2026-03-20 10:20:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d651fd-f40e-542e-a51b-70669b5aace5 with scrape type 1
2026-03-20 10:20:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67d651fd-f40e-542e-a51b-70669b5aace5 sending to next pipeline
2026-03-20 10:20:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 67d651fd-f40e-542e-a51b-70669b5aace5, identifier: RD99814
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a33110>
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_d805db81398895aaf5acbc4bb5413d69.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_d805db81398895aaf5acbc4bb5413d69.jpg saved to cache
2026-03-20 10:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81ac9290>
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_6fe6483d7e2239e90844903c51cc978d.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_6fe6483d7e2239e90844903c51cc978d.jpg saved to cache
2026-03-20 10:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:20:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 67d651fd-f40e-542e-a51b-70669b5aace5 with identifier: RD99814
2026-03-20 10:20:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 67d651fd-f40e-542e-a51b-70669b5aace5 with identifier: RD99814
2026-03-20 10:20:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 67d651fd-f40e-542e-a51b-70669b5aace5 with identifier: RD99814 to the API
2026-03-20 10:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5095648057ea9c5932d475322f7e914f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-21T16:57:42Z',
 'fuel_type': 'diesel',
 'id': '67d651fd-f40e-542e-a51b-70669b5aace5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TH-782-J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD99814',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 212970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5033cbea8c239a1d37e86b9e7fae7ae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_ddf2a2a4c71884b8ff04762fe114edc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_c90ad227d816ab77dc44601bc53841d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_279ac87ddb9b6e2f28ccf6caf8bd0e81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_e3f94cd0f3cfa816449727bb06f9cd58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_5095648057ea9c5932d475322f7e914f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_7520498530dede93d9186f2e2c6fa280.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_9e1600f1acc61d1fc596c0c62c6568bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_6415a33a935137f0c3d8d0ac7394171e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67d651fd-f40e-542e-a51b-70669b5aace5/67d651fd-f40e-542e-a51b-70669b5aace5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/2a/d02aa6ea0baaa84cf6d21544d12cbc36/pa/RD99814_1f855b1de1b25043bcd49d26d2e5af0b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Ambiente',
 'transmission': 'automatic',
 'trim': 'lang Ambiente',
 'year': 2010}
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD99814%27 HTTP/1.1" 200 None
2026-03-20 10:20:02 [auto1.nl] INFO: Saving data for RD99814: {'created_time': 1774002002.279339, 'last_price_update_time': 1774002002.279349, 'auction_closing_time': 1774112262.0}
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD99814') HTTP/1.1" 204 0
2026-03-20 10:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_98e3308d2035613f59aa76df0a191328.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:02 [auto1.nl] INFO: Found listing with ID: CF34624
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF34624%27 HTTP/1.1" 200 None
2026-03-20 10:20:02 [auto1.nl] INFO: Scrape type for CF34624: 1
2026-03-20 10:20:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81cc7fd0>
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_1ac708278a1665ef1673502019ac3d2f.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_1ac708278a1665ef1673502019ac3d2f.jpg saved to cache
2026-03-20 10:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_a3dd7b8506a10785e037376dce2d0e20.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_64c6f0e58ca0230dfc39134d5b0f01d3.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:02 [auto1.nl] INFO: Found listing with ID: FD46259
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD46259%27 HTTP/1.1" 200 None
2026-03-20 10:20:02 [auto1.nl] INFO: Scrape type for FD46259: 0
2026-03-20 10:20:02 [auto1.nl] INFO: Found listing with ID: RG36206
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG36206%27 HTTP/1.1" 200 None
2026-03-20 10:20:02 [auto1.nl] INFO: Scrape type for RG36206: 1
2026-03-20 10:20:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e6f210>
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F3e%252Ff13e8aa6ac1193eb90ab8a6c4c56fc6e%252Fpa%252FEM54689_972a6f9be475c943437df79b96333d14.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_972a6f9be475c943437df79b96333d14.jpg saved to cache
2026-03-20 10:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f97ac31-2748-5a67-9214-311dd2f94c34
2026-03-20 10:20:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f97ac31-2748-5a67-9214-311dd2f94c34, skipping ID generation
2026-03-20 10:20:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f97ac31-2748-5a67-9214-311dd2f94c34 with scrape type 1
2026-03-20 10:20:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f97ac31-2748-5a67-9214-311dd2f94c34 sending to next pipeline
2026-03-20 10:20:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1f97ac31-2748-5a67-9214-311dd2f94c34, identifier: EM54689
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83ac0110>
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F8d%252F078d806dc159b2b647a6e60a428d4752%252Fpa%252FHX69861_b31dece6ecf363f3449e5c0944780f6f.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_b31dece6ecf363f3449e5c0944780f6f.jpg saved to cache
2026-03-20 10:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780
2026-03-20 10:20:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 759c289a-6f1a-5c6d-a4c3-9cdd63597780, skipping ID generation
2026-03-20 10:20:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with scrape type 1
2026-03-20 10:20:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 759c289a-6f1a-5c6d-a4c3-9cdd63597780 sending to next pipeline
2026-03-20 10:20:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 759c289a-6f1a-5c6d-a4c3-9cdd63597780, identifier: HX69861
2026-03-20 10:20:02 [auto1.nl] INFO: Found listing with ID: FR73964
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR73964%27 HTTP/1.1" 200 None
2026-03-20 10:20:02 [auto1.nl] INFO: Scrape type for FR73964: 0
2026-03-20 10:20:02 [auto1.nl] INFO: Found listing with ID: GD85766
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD85766%27 HTTP/1.1" 200 None
2026-03-20 10:20:02 [auto1.nl] INFO: Scrape type for GD85766: 1
2026-03-20 10:20:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1f97ac31-2748-5a67-9214-311dd2f94c34 with identifier: EM54689
2026-03-20 10:20:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1f97ac31-2748-5a67-9214-311dd2f94c34 with identifier: EM54689
2026-03-20 10:20:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1f97ac31-2748-5a67-9214-311dd2f94c34 with identifier: EM54689 to the API
2026-03-20 10:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_972a6f9be475c943437df79b96333d14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-21T16:24:38Z',
 'fuel_type': 'petrol',
 'id': '1f97ac31-2748-5a67-9214-311dd2f94c34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HK334G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM54689',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'BMW',
 'model': '3er',
 'odometer': 124318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_775b005ce69f329e01a89d8de0c7a361.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_257baf5fbef33dba8467f9d3c81167c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_fd94e6fa2c02f3f81559d26c8cf6b66a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_dfe66c7268812162fa0ab1b5868d5f57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_2637087ae020e01b7e04bd47f6ac9d15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_16f5138db42b0e3abd11f1a9c1f9ca49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_3ff5351543623d42824b74d89078bcef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_972a6f9be475c943437df79b96333d14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_1ac708278a1665ef1673502019ac3d2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f97ac31-2748-5a67-9214-311dd2f94c34/1f97ac31-2748-5a67-9214-311dd2f94c34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/3e/f13e8aa6ac1193eb90ab8a6c4c56fc6e/pa/EM54689_2c3957ad3cfd2aee13b29205ce9cb40e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2015}
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54689%27 HTTP/1.1" 200 None
2026-03-20 10:20:03 [auto1.nl] INFO: Saving data for EM54689: {'created_time': 1774002003.409235, 'last_price_update_time': 1774002003.409248, 'auction_closing_time': 1774110278.0}
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM54689') HTTP/1.1" 204 0
2026-03-20 10:20:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861
2026-03-20 10:20:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861
2026-03-20 10:20:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 759c289a-6f1a-5c6d-a4c3-9cdd63597780 with identifier: HX69861 to the API
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_b31dece6ecf363f3449e5c0944780f6f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-21T16:56:12Z',
 'fuel_type': 'diesel',
 'id': '759c289a-6f1a-5c6d-a4c3-9cdd63597780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HJ944J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX69861',
 'listing': 'auction',
 'location': 'NL, Zaandam',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 386924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1101283,
             'Height': 1116,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_51f2d1ffd83d861d0968c7a134be24a8.jpg',
             'Width': 1488},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_ffca66c41e1de596b69fe3f5b3f68b67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_93f967ab82dc75483bc5cb4345855a13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_67e2f4d192b005b2e6a686eef5a78f7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_c686e840de4c1f5fccf6f71206c1595e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_1fe2c8cff3db552c2ae1dcedb9f2f3c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_d66933db1b6c68bd29219a2f0bf229f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_8233bc762aeddea5a8160c46ce8205c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_b820c7c909656ce02f86cf9b02ef5b52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759c289a-6f1a-5c6d-a4c3-9cdd63597780/759c289a-6f1a-5c6d-a4c3-9cdd63597780_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/8d/078d806dc159b2b647a6e60a428d4752/pa/HX69861_b31dece6ecf363f3449e5c0944780f6f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'lang 4Matic BlueTEC Avantgarde',
 'year': 2015}
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-20 10:20:03 [auto1.nl] INFO: Saving data for HX69861: {'created_time': 1774002003.933543, 'last_price_update_time': 1774002003.933554, 'auction_closing_time': 1774112172.0}
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX69861') HTTP/1.1" 204 0
2026-03-20 10:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e583d0>
2026-03-20 10:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_98e3308d2035613f59aa76df0a191328.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_98e3308d2035613f59aa76df0a191328.jpg saved to cache
2026-03-20 10:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:20:04 [auto1.nl] INFO: Found listing with ID: HW32477
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32477%27 HTTP/1.1" 200 None
2026-03-20 10:20:04 [auto1.nl] INFO: Scrape type for HW32477: 1
2026-03-20 10:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ37238/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_cdbaaecb6c4e5d4d42a4e5d2245f1c20.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR69435/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80fac9d0>
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F3b%252Fa03bd2915f990acf35f2048a0361fbed%252Fpa%252FAD85278_a3dd7b8506a10785e037376dce2d0e20.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_a3dd7b8506a10785e037376dce2d0e20.jpg saved to cache
2026-03-20 10:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f43db7c7-5211-573b-9ea1-2b34b361898b
2026-03-20 10:20:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f43db7c7-5211-573b-9ea1-2b34b361898b, skipping ID generation
2026-03-20 10:20:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f43db7c7-5211-573b-9ea1-2b34b361898b with scrape type 1
2026-03-20 10:20:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f43db7c7-5211-573b-9ea1-2b34b361898b sending to next pipeline
2026-03-20 10:20:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f43db7c7-5211-573b-9ea1-2b34b361898b, identifier: AD85278
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f95810>
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_64c6f0e58ca0230dfc39134d5b0f01d3.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_64c6f0e58ca0230dfc39134d5b0f01d3.jpg saved to cache
2026-03-20 10:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:20:04 [auto1.nl] INFO: Found listing with ID: VJ43078
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ43078%27 HTTP/1.1" 200 None
2026-03-20 10:20:04 [auto1.nl] INFO: Scrape type for VJ43078: 1
2026-03-20 10:20:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f43db7c7-5211-573b-9ea1-2b34b361898b with identifier: AD85278
2026-03-20 10:20:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f43db7c7-5211-573b-9ea1-2b34b361898b with identifier: AD85278
2026-03-20 10:20:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f43db7c7-5211-573b-9ea1-2b34b361898b with identifier: AD85278 to the API
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_a3dd7b8506a10785e037376dce2d0e20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 147,
 'expiration_date': '2026-03-21T16:43:17Z',
 'fuel_type': 'petrol',
 'id': 'f43db7c7-5211-573b-9ea1-2b34b361898b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '60NRB2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD85278',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 175628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_8ec1e0344283f85a86aef49278268341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_ac52f695424d19e3a33773640523178d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_f57d44d3e7a13b05a16d225c068af754.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_a3dd7b8506a10785e037376dce2d0e20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_80c6d7febbee88923e3ff2f4cf6914a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43db7c7-5211-573b-9ea1-2b34b361898b/f43db7c7-5211-573b-9ea1-2b34b361898b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/3b/a03bd2915f990acf35f2048a0361fbed/pa/AD85278_4d42a37df0bfcdd736b2a3d4c31a47f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2005}
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD85278%27 HTTP/1.1" 200 None
2026-03-20 10:20:04 [auto1.nl] INFO: Saving data for AD85278: {'created_time': 1774002004.814552, 'last_price_update_time': 1774002004.814562, 'auction_closing_time': 1774111397.0}
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AD85278') HTTP/1.1" 204 0
2026-03-20 10:20:04 [auto1.nl] INFO: Found listing with ID: RL17595
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL17595%27 HTTP/1.1" 200 None
2026-03-20 10:20:04 [auto1.nl] INFO: Scrape type for RL17595: 1
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f95a10>
2026-03-20 10:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg saved to cache
2026-03-20 10:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389
2026-03-20 10:20:05 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 1055 | hits on page: 40
2026-03-20 10:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf819bd150>
2026-03-20 10:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_cdbaaecb6c4e5d4d42a4e5d2245f1c20.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_cdbaaecb6c4e5d4d42a4e5d2245f1c20.jpg saved to cache
2026-03-20 10:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL62250/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_9b554d6d0b9910935a7b9d5fff28e045.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: TS83141
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS83141%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for TS83141: 1
2026-03-20 10:20:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RV40948%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for RV40948: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: YM85500
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM85500%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for YM85500: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for ET47420: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for YP02517: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: MN51913
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN51913%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for MN51913: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: AR33900
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR33900%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for AR33900: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK31365%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for KK31365: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT87192%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for TT87192: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK51232%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for ZK51232: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH47891%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for BH47891: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: VE44082
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE44082%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for VE44082: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: VB49351
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB49351%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for VB49351: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for ME20407: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ22600%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for PZ22600: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: DW76310
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW76310%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for DW76310: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for UE65811: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: PF11977
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF11977%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for PF11977: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN10776%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for NN10776: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for MD55137: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: DL49064
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL49064%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for DL49064: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: LT47952
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT47952%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for LT47952: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for GW58352: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for CK43593: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU39943%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for LU39943: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for DL13637: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: JR78736
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR78736%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for JR78736: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: GJ39127
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ39127%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for GJ39127: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for FR61201: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: DJ58295
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ58295%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for DJ58295: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG42782%27 HTTP/1.1" 200 None
2026-03-20 10:20:05 [auto1.nl] INFO: Scrape type for WG42782: 0
2026-03-20 10:20:05 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-20 10:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-20 10:20:06 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-20 10:20:06 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP53707%27 HTTP/1.1" 200 None
2026-03-20 10:20:06 [auto1.nl] INFO: Scrape type for ZP53707: 0
2026-03-20 10:20:06 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-20 10:20:06 [auto1.nl] INFO: Scrape type for EP93197: 0
2026-03-20 10:20:06 [auto1.nl] INFO: Found listing with ID: NG19545
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG19545%27 HTTP/1.1" 200 None
2026-03-20 10:20:06 [auto1.nl] INFO: Scrape type for NG19545: 0
2026-03-20 10:20:06 [auto1.nl] INFO: Found listing with ID: JS15823
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS15823%27 HTTP/1.1" 200 None
2026-03-20 10:20:06 [auto1.nl] INFO: Scrape type for JS15823: 1
2026-03-20 10:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_b77eb0fbbbe23c45ff6f04a5333ee87d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML02089> (referer: https://www.auto1.com/v1/car-details-view/ML02089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF53810> (referer: https://www.auto1.com/v1/car-details-view/WF53810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf810df490>
2026-03-20 10:20:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_9b554d6d0b9910935a7b9d5fff28e045.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_9b554d6d0b9910935a7b9d5fff28e045.jpg saved to cache
2026-03-20 10:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:20:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_a04c15f3b522b97268998765f45a7784.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_b6199bdf24207c6e40a85bbaaee9fc57.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_d703f399fe185b6e153bc5d6a08ab126.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-20 10:20:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-20 10:20:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-20 10:20:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-20 10:20:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-20 10:20:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a0f310>
2026-03-20 10:20:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fdd%252F47ddd73f930fb997d0e5836b8adac80b%252Fpa%252FJH24547_b77eb0fbbbe23c45ff6f04a5333ee87d.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_b77eb0fbbbe23c45ff6f04a5333ee87d.jpg saved to cache
2026-03-20 10:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64fcd272-55ff-5554-82d7-a83a99840a93
2026-03-20 10:20:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64fcd272-55ff-5554-82d7-a83a99840a93, skipping ID generation
2026-03-20 10:20:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64fcd272-55ff-5554-82d7-a83a99840a93 with scrape type 1
2026-03-20 10:20:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64fcd272-55ff-5554-82d7-a83a99840a93 sending to next pipeline
2026-03-20 10:20:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 64fcd272-55ff-5554-82d7-a83a99840a93, identifier: JH24547
2026-03-20 10:20:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547
2026-03-20 10:20:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547
2026-03-20 10:20:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 64fcd272-55ff-5554-82d7-a83a99840a93 with identifier: JH24547 to the API
2026-03-20 10:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_b77eb0fbbbe23c45ff6f04a5333ee87d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-21T16:59:31Z',
 'fuel_type': 'petrol',
 'id': '64fcd272-55ff-5554-82d7-a83a99840a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH24547',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 134675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4058359,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_b77eb0fbbbe23c45ff6f04a5333ee87d.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_f0e6f3b8e9590375dace3745b62d8941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_efa473a86a342d1319740c6e07f2865c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_4315d653f57fdf54e53f914edf330a1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_57c856dd6ca266c71de6ea0be0723a13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_33cb476184c8e2fd1423edcf0d38cee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_f91e26fd307eb0836eb9d254b01a9760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_bedb78869f63cd5a2c3f98ab0e070f32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_c70a14e27554ccc43e8fb94254e15998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64fcd272-55ff-5554-82d7-a83a99840a93/64fcd272-55ff-5554-82d7-a83a99840a93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/dd/47ddd73f930fb997d0e5836b8adac80b/pa/JH24547_6257fb935679ccdc5ca86d85e8f1d8ba.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2011}
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [auto1.nl] INFO: Saving data for JH24547: {'created_time': 1774002007.214212, 'last_price_update_time': 1774002007.214225, 'auction_closing_time': 1774112371.0}
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JH24547') HTTP/1.1" 204 0
2026-03-20 10:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_4940f773fc49f83aef11ae5cb05cb0ff.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4709130-58ba-57fa-912d-f8022c5a0e35 with identifier: ML02089
2026-03-20 10:20:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4709130-58ba-57fa-912d-f8022c5a0e35 with scrape type 1
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f4709130-58ba-57fa-912d-f8022c5a0e35
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F1b%252F261b833eb1fd7e52923fced04db52bfd%252Fpa%252FML02089_94fd92087730cacbf346eff194d73d29.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_94fd92087730cacbf346eff194d73d29.jpg already downloaded
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F1b%252F261b833eb1fd7e52923fced04db52bfd%252Fpa%252FML02089_8fe89e2c7789b1785cf6e5930630428b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_8fe89e2c7789b1785cf6e5930630428b.jpg already downloaded
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F1b%252F261b833eb1fd7e52923fced04db52bfd%252Fpa%252FML02089_63ffb8d81b14e2bc7ec728969790927c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_63ffb8d81b14e2bc7ec728969790927c.jpg already downloaded
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F1b%252F261b833eb1fd7e52923fced04db52bfd%252Fpa%252FML02089_a7112425e399e8c5ae60a74a9a4782b7.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_a7112425e399e8c5ae60a74a9a4782b7.jpg already downloaded
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F1b%252F261b833eb1fd7e52923fced04db52bfd%252Fpa%252FML02089_9d08ab7c6c37d07617d1d842eab6534e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_9d08ab7c6c37d07617d1d842eab6534e.jpg already downloaded
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F1b%252F261b833eb1fd7e52923fced04db52bfd%252Fpa%252FML02089_f3fe4d18125bdf6deca304e8d6e1b8cd.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_f3fe4d18125bdf6deca304e8d6e1b8cd.jpg already downloaded
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F1b%252F261b833eb1fd7e52923fced04db52bfd%252Fpa%252FML02089_019e03c8f09be29ac7ad78b9a563a1b8.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_019e03c8f09be29ac7ad78b9a563a1b8.jpg already downloaded
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F1b%252F261b833eb1fd7e52923fced04db52bfd%252Fpa%252FML02089_86cb36be5def2771b07278fad482b6b6.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_86cb36be5def2771b07278fad482b6b6.jpg already downloaded
2026-03-20 10:20:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f4709130-58ba-57fa-912d-f8022c5a0e35, identifier: ML02089
2026-03-20 10:20:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3f94d16-b21a-5021-86da-f5bf1370d6ab with identifier: WF53810
2026-03-20 10:20:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3f94d16-b21a-5021-86da-f5bf1370d6ab with scrape type 1
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e3f94d16-b21a-5021-86da-f5bf1370d6ab
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_64ff8a071cc47369abc771b98b3e332f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_64ff8a071cc47369abc771b98b3e332f.jpg not downloaded yet
2026-03-20 10:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG36206/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF34624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB80736> (referer: https://www.auto1.com/v1/car-details-view/NB80736/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD85766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f4709130-58ba-57fa-912d-f8022c5a0e35 with identifier: ML02089
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-20 10:20:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-20 10:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-20 10:20:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f4709130-58ba-57fa-912d-f8022c5a0e35 with identifier: ML02089
2026-03-20 10:20:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f4709130-58ba-57fa-912d-f8022c5a0e35 with identifier: ML02089 to the API
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML02089>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 184,
 'expiration_date': '2026-03-21T16:17:14Z',
 'fuel_type': 'electro',
 'id': 'f4709130-58ba-57fa-912d-f8022c5a0e35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML02089',
 'listing': 'auction',
 'location': 'NL',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 32357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photo_urls': ['https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_94fd92087730cacbf346eff194d73d29.jpg',
                'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_8fe89e2c7789b1785cf6e5930630428b.jpg',
                'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_63ffb8d81b14e2bc7ec728969790927c.jpg',
                'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_a7112425e399e8c5ae60a74a9a4782b7.jpg',
                'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_9d08ab7c6c37d07617d1d842eab6534e.jpg',
                'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_f3fe4d18125bdf6deca304e8d6e1b8cd.jpg',
                'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_019e03c8f09be29ac7ad78b9a563a1b8.jpg',
                'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_86cb36be5def2771b07278fad482b6b6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4709130-58ba-57fa-912d-f8022c5a0e35/f4709130-58ba-57fa-912d-f8022c5a0e35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292495,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_94fd92087730cacbf346eff194d73d29.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4709130-58ba-57fa-912d-f8022c5a0e35/f4709130-58ba-57fa-912d-f8022c5a0e35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301056,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_8fe89e2c7789b1785cf6e5930630428b.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4709130-58ba-57fa-912d-f8022c5a0e35/f4709130-58ba-57fa-912d-f8022c5a0e35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297643,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_63ffb8d81b14e2bc7ec728969790927c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4709130-58ba-57fa-912d-f8022c5a0e35/f4709130-58ba-57fa-912d-f8022c5a0e35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304339,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_a7112425e399e8c5ae60a74a9a4782b7.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4709130-58ba-57fa-912d-f8022c5a0e35/f4709130-58ba-57fa-912d-f8022c5a0e35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374978,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_9d08ab7c6c37d07617d1d842eab6534e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4709130-58ba-57fa-912d-f8022c5a0e35/f4709130-58ba-57fa-912d-f8022c5a0e35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438371,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_f3fe4d18125bdf6deca304e8d6e1b8cd.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4709130-58ba-57fa-912d-f8022c5a0e35/f4709130-58ba-57fa-912d-f8022c5a0e35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419707,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_019e03c8f09be29ac7ad78b9a563a1b8.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4709130-58ba-57fa-912d-f8022c5a0e35/f4709130-58ba-57fa-912d-f8022c5a0e35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305657,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img26/1b/261b833eb1fd7e52923fced04db52bfd/pa/ML02089_86cb36be5def2771b07278fad482b6b6.jpg',
             'Width': 1920}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper SE Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2022}
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML02089%27 HTTP/1.1" 200 None
2026-03-20 10:20:08 [auto1.nl] INFO: Saving data for ML02089: {'created_time': 1774002008.347364, 'last_price_update_time': 1774002008.347375, 'auction_closing_time': 1774109834.0}
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML02089') HTTP/1.1" 204 0
2026-03-20 10:20:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_6d4833d3056555875a094b9b2b1e0656.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_6d4833d3056555875a094b9b2b1e0656.jpg not downloaded yet
2026-03-20 10:20:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81bf79d0>
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_a04c15f3b522b97268998765f45a7784.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_a04c15f3b522b97268998765f45a7784.jpg saved to cache
2026-03-20 10:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:20:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80fd4150>
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_b6199bdf24207c6e40a85bbaaee9fc57.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_b6199bdf24207c6e40a85bbaaee9fc57.jpg saved to cache
2026-03-20 10:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:20:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83d4f450>
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_d703f399fe185b6e153bc5d6a08ab126.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_d703f399fe185b6e153bc5d6a08ab126.jpg saved to cache
2026-03-20 10:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_ec560bdc2e1398f6692aeee89ea4043d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_ec560bdc2e1398f6692aeee89ea4043d.jpg not downloaded yet
2026-03-20 10:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS60646/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c8bf50>
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F80%252Fe4800fd2409e0daa0920bde31e0f45bb%252Fpa%252FEF13985_4940f773fc49f83aef11ae5cb05cb0ff.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_4940f773fc49f83aef11ae5cb05cb0ff.jpg saved to cache
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8dd64499-be69-5cf3-a582-237d1f997b11
2026-03-20 10:20:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8dd64499-be69-5cf3-a582-237d1f997b11, skipping ID generation
2026-03-20 10:20:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dd64499-be69-5cf3-a582-237d1f997b11 with scrape type 1
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dd64499-be69-5cf3-a582-237d1f997b11 sending to next pipeline
2026-03-20 10:20:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8dd64499-be69-5cf3-a582-237d1f997b11, identifier: EF13985
2026-03-20 10:20:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e with identifier: NB80736
2026-03-20 10:20:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e with scrape type 1
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_3530a5b1184b9c82fd333e86a11128d3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_3530a5b1184b9c82fd333e86a11128d3.jpg not downloaded yet
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_384cbea345a44d0852cea6ef6c0c2622.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_384cbea345a44d0852cea6ef6c0c2622.jpg not downloaded yet
2026-03-20 10:20:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8dd64499-be69-5cf3-a582-237d1f997b11 with identifier: EF13985
2026-03-20 10:20:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8dd64499-be69-5cf3-a582-237d1f997b11 with identifier: EF13985
2026-03-20 10:20:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8dd64499-be69-5cf3-a582-237d1f997b11 with identifier: EF13985 to the API
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_4940f773fc49f83aef11ae5cb05cb0ff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-21T16:23:37Z',
 'fuel_type': 'petrol',
 'id': '8dd64499-be69-5cf3-a582-237d1f997b11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'G551XL',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF13985',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 111671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3204305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_a04c15f3b522b97268998765f45a7784.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_375aa1658e513f71257e69f4beef1759.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_98e3308d2035613f59aa76df0a191328.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_649ea837b573d740925f76558c9ba711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3153767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_d703f399fe185b6e153bc5d6a08ab126.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_5990fc7da82c7225df52f7f6771cb1b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2739837,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_b6199bdf24207c6e40a85bbaaee9fc57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_6fe6483d7e2239e90844903c51cc978d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_d805db81398895aaf5acbc4bb5413d69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dd64499-be69-5cf3-a582-237d1f997b11/8dd64499-be69-5cf3-a582-237d1f997b11_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/80/e4800fd2409e0daa0920bde31e0f45bb/pa/EF13985_4940f773fc49f83aef11ae5cb05cb0ff.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF13985%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [auto1.nl] INFO: Saving data for EF13985: {'created_time': 1774002009.604663, 'last_price_update_time': 1774002009.604672, 'auction_closing_time': 1774110217.0}
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EF13985') HTTP/1.1" 204 0
2026-03-20 10:20:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_b11d396ebb5f9c44ab33e4e61a6c599b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_b11d396ebb5f9c44ab33e4e61a6c599b.jpg not downloaded yet
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_28309fa32ea09e112e86558595ee5e09.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_28309fa32ea09e112e86558595ee5e09.jpg not downloaded yet
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW32477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_9c056d3e226408e6df3c685fe32a74a0.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_9c056d3e226408e6df3c685fe32a74a0.jpg not downloaded yet
2026-03-20 10:20:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_3fd548bca1ab2f3739d10de4780f0b87.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_64ff8a071cc47369abc771b98b3e332f.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_db025a5473219c01920a6d2cdc2affdf.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_598838b6ecf5202129904325e3f54843.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_598838b6ecf5202129904325e3f54843.jpg not downloaded yet
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_542269a4861502f1a2a566a90f9815c6.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_2b0a67c5bf8a38450f9a39d48df3a293.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_2b0a67c5bf8a38450f9a39d48df3a293.jpg not downloaded yet
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_f303aadbbc17903ffb70ed294c013e13.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_f303aadbbc17903ffb70ed294c013e13.jpg not downloaded yet
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_57091dae45624362a83ba3e4a00b989b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_57091dae45624362a83ba3e4a00b989b.jpg not downloaded yet
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_b11d396ebb5f9c44ab33e4e61a6c599b.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_6d4833d3056555875a094b9b2b1e0656.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_384cbea345a44d0852cea6ef6c0c2622.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_f68dcfd25cdeb5b8b18d529b786ff517.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_f68dcfd25cdeb5b8b18d529b786ff517.jpg not downloaded yet
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_28309fa32ea09e112e86558595ee5e09.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_9854812064e10a0b340915dd49029f2f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_9854812064e10a0b340915dd49029f2f.jpg not downloaded yet
2026-03-20 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_ec560bdc2e1398f6692aeee89ea4043d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f40590>
2026-03-20 10:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_3fd548bca1ab2f3739d10de4780f0b87.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_3fd548bca1ab2f3739d10de4780f0b87.jpg saved to cache
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c1a7d0>
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_64ff8a071cc47369abc771b98b3e332f.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_64ff8a071cc47369abc771b98b3e332f.jpg saved to cache
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3f94d16-b21a-5021-86da-f5bf1370d6ab
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f7a5d0>
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F1e%252F0d1e7a835d014233e4d6979d2836ce10%252Fpa%252FCV57323_db025a5473219c01920a6d2cdc2affdf.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_db025a5473219c01920a6d2cdc2affdf.jpg saved to cache
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389
2026-03-20 10:20:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389, skipping ID generation
2026-03-20 10:20:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with scrape type 1
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 sending to next pipeline
2026-03-20 10:20:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389, identifier: CV57323
2026-03-20 10:20:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with identifier: CV57323
2026-03-20 10:20:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with identifier: CV57323
2026-03-20 10:20:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7406bb73-b3a5-587f-a6cb-1bc6e1c1b389 with identifier: CV57323 to the API
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_db025a5473219c01920a6d2cdc2affdf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-21T16:17:51Z',
 'fuel_type': 'petrol',
 'id': '7406bb73-b3a5-587f-a6cb-1bc6e1c1b389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '4TGD18',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV57323',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 174800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_0967c9fa3d6d10f4d90e8eac14da0b6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_db025a5473219c01920a6d2cdc2affdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_8ed745d21d9fc9d16f96304433931d29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_60eca82d0e32b08e96cf546a8e75ef71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7406bb73-b3a5-587f-a6cb-1bc6e1c1b389/7406bb73-b3a5-587f-a6cb-1bc6e1c1b389_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/1e/0d1e7a835d014233e4d6979d2836ce10/pa/CV57323_e7041878fafc6c9e68bea2758874d79a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV57323%27 HTTP/1.1" 200 None
2026-03-20 10:20:10 [auto1.nl] INFO: Saving data for CV57323: {'created_time': 1774002010.666059, 'last_price_update_time': 1774002010.666073, 'auction_closing_time': 1774109871.0}
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CV57323') HTTP/1.1" 204 0
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83d4a750>
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F1f%252Fb81f409262de7383a2d5ba7476436341%252Fpa%252FTL68396_542269a4861502f1a2a566a90f9815c6.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_542269a4861502f1a2a566a90f9815c6.jpg saved to cache
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b6a4420-be2b-56b4-8004-345bc2507287
2026-03-20 10:20:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b6a4420-be2b-56b4-8004-345bc2507287, skipping ID generation
2026-03-20 10:20:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6a4420-be2b-56b4-8004-345bc2507287 with scrape type 1
2026-03-20 10:20:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b6a4420-be2b-56b4-8004-345bc2507287 sending to next pipeline
2026-03-20 10:20:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b6a4420-be2b-56b4-8004-345bc2507287, identifier: TL68396
2026-03-20 10:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_598838b6ecf5202129904325e3f54843.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_f303aadbbc17903ffb70ed294c013e13.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b6a4420-be2b-56b4-8004-345bc2507287 with identifier: TL68396
2026-03-20 10:20:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b6a4420-be2b-56b4-8004-345bc2507287 with identifier: TL68396
2026-03-20 10:20:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b6a4420-be2b-56b4-8004-345bc2507287 with identifier: TL68396 to the API
2026-03-20 10:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_542269a4861502f1a2a566a90f9815c6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 354,
 'expiration_date': '2026-03-21T16:13:30Z',
 'fuel_type': 'petrol',
 'id': '6b6a4420-be2b-56b4-8004-345bc2507287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GKV-52-R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL68396',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 171896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_4f86e80c19526e6f479b0a91c188c1dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_ccc76ec9573434bdde75afa802b65c04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_278e474fc4f25c2fd73f01707d265cb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_542269a4861502f1a2a566a90f9815c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_817e5ccaeb3c3f98722c457d63bb675e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_cdbaaecb6c4e5d4d42a4e5d2245f1c20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_28f135371e1781d202f9b3b6ebeb4a6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_64c6f0e58ca0230dfc39134d5b0f01d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_fc28b5af2603b29cda2568052655c1e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6a4420-be2b-56b4-8004-345bc2507287/6b6a4420-be2b-56b4-8004-345bc2507287_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/1f/b81f409262de7383a2d5ba7476436341/pa/TL68396_caffe6e341acee001770bb88e9dfd9ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL68396%27 HTTP/1.1" 200 None
2026-03-20 10:20:11 [auto1.nl] INFO: Saving data for TL68396: {'created_time': 1774002011.809598, 'last_price_update_time': 1774002011.809608, 'auction_closing_time': 1774109610.0}
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TL68396') HTTP/1.1" 204 0
2026-03-20 10:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_57091dae45624362a83ba3e4a00b989b.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_2b0a67c5bf8a38450f9a39d48df3a293.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS15823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS83141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR69435> (referer: https://www.auto1.com/v1/car-details-view/JR69435/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f36210>
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_b11d396ebb5f9c44ab33e4e61a6c599b.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_b11d396ebb5f9c44ab33e4e61a6c599b.jpg saved to cache
2026-03-20 10:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8104ee10>
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_6d4833d3056555875a094b9b2b1e0656.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_6d4833d3056555875a094b9b2b1e0656.jpg saved to cache
2026-03-20 10:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3f94d16-b21a-5021-86da-f5bf1370d6ab
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81acc0d0>
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_384cbea345a44d0852cea6ef6c0c2622.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_384cbea345a44d0852cea6ef6c0c2622.jpg saved to cache
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3f94d16-b21a-5021-86da-f5bf1370d6ab
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f35850>
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_28309fa32ea09e112e86558595ee5e09.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_28309fa32ea09e112e86558595ee5e09.jpg saved to cache
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3f94d16-b21a-5021-86da-f5bf1370d6ab
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e5a6d0>
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_ec560bdc2e1398f6692aeee89ea4043d.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_ec560bdc2e1398f6692aeee89ea4043d.jpg saved to cache
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3f94d16-b21a-5021-86da-f5bf1370d6ab
2026-03-20 10:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_f68dcfd25cdeb5b8b18d529b786ff517.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ37238> (referer: https://www.auto1.com/v1/car-details-view/HJ37238/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80ee9410>
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_598838b6ecf5202129904325e3f54843.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_598838b6ecf5202129904325e3f54843.jpg saved to cache
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3f94d16-b21a-5021-86da-f5bf1370d6ab
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81057c50>
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_f303aadbbc17903ffb70ed294c013e13.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_f303aadbbc17903ffb70ed294c013e13.jpg saved to cache
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3f94d16-b21a-5021-86da-f5bf1370d6ab
2026-03-20 10:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF94302> (referer: https://www.auto1.com/v1/car-details-view/CF94302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d7ce50>
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_57091dae45624362a83ba3e4a00b989b.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_57091dae45624362a83ba3e4a00b989b.jpg saved to cache
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e5cd10>
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_2b0a67c5bf8a38450f9a39d48df3a293.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_2b0a67c5bf8a38450f9a39d48df3a293.jpg saved to cache
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e
2026-03-20 10:20:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a440c7d-1ffe-5236-b60d-40e73fa0eadf with identifier: JR69435
2026-03-20 10:20:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a440c7d-1ffe-5236-b60d-40e73fa0eadf with scrape type 1
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6a440c7d-1ffe-5236-b60d-40e73fa0eadf
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd7%252F96d7c3a10cf681a9fe8b4bc1e7b2d30c%252Fpa%252FJR69435_bba9b447afe25596c1d2a0f85892cf35.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_bba9b447afe25596c1d2a0f85892cf35.jpg already downloaded
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd7%252F96d7c3a10cf681a9fe8b4bc1e7b2d30c%252Fpa%252FJR69435_346e81e5a368cb008a186438e80cd1ba.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_346e81e5a368cb008a186438e80cd1ba.jpg already downloaded
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd7%252F96d7c3a10cf681a9fe8b4bc1e7b2d30c%252Fpa%252FJR69435_e0f660fbe1f40b555b230ef4e6b30694.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_e0f660fbe1f40b555b230ef4e6b30694.jpg already downloaded
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd7%252F96d7c3a10cf681a9fe8b4bc1e7b2d30c%252Fpa%252FJR69435_faaadc991421d10c0a571d1a3c24afd4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_faaadc991421d10c0a571d1a3c24afd4.jpg already downloaded
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd7%252F96d7c3a10cf681a9fe8b4bc1e7b2d30c%252Fpa%252FJR69435_262e029d6670324d070085cda8878e13.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_262e029d6670324d070085cda8878e13.jpg already downloaded
2026-03-20 10:20:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6a440c7d-1ffe-5236-b60d-40e73fa0eadf, identifier: JR69435
2026-03-20 10:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_9854812064e10a0b340915dd49029f2f.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_3530a5b1184b9c82fd333e86a11128d3.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_9c056d3e226408e6df3c685fe32a74a0.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6a440c7d-1ffe-5236-b60d-40e73fa0eadf with identifier: JR69435
2026-03-20 10:20:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6a440c7d-1ffe-5236-b60d-40e73fa0eadf with identifier: JR69435
2026-03-20 10:20:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6a440c7d-1ffe-5236-b60d-40e73fa0eadf with identifier: JR69435 to the API
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR69435>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-21T16:11:44Z',
 'fuel_type': 'petrol',
 'id': '6a440c7d-1ffe-5236-b60d-40e73fa0eadf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '3TGX38',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR69435',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 197615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_bba9b447afe25596c1d2a0f85892cf35.jpg',
                'https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_346e81e5a368cb008a186438e80cd1ba.jpg',
                'https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_e0f660fbe1f40b555b230ef4e6b30694.jpg',
                'https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_faaadc991421d10c0a571d1a3c24afd4.jpg',
                'https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_262e029d6670324d070085cda8878e13.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a440c7d-1ffe-5236-b60d-40e73fa0eadf/6a440c7d-1ffe-5236-b60d-40e73fa0eadf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_bba9b447afe25596c1d2a0f85892cf35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a440c7d-1ffe-5236-b60d-40e73fa0eadf/6a440c7d-1ffe-5236-b60d-40e73fa0eadf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_346e81e5a368cb008a186438e80cd1ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a440c7d-1ffe-5236-b60d-40e73fa0eadf/6a440c7d-1ffe-5236-b60d-40e73fa0eadf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_e0f660fbe1f40b555b230ef4e6b30694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a440c7d-1ffe-5236-b60d-40e73fa0eadf/6a440c7d-1ffe-5236-b60d-40e73fa0eadf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_faaadc991421d10c0a571d1a3c24afd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a440c7d-1ffe-5236-b60d-40e73fa0eadf/6a440c7d-1ffe-5236-b60d-40e73fa0eadf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d7/96d7c3a10cf681a9fe8b4bc1e7b2d30c/pa/JR69435_262e029d6670324d070085cda8878e13.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR69435%27 HTTP/1.1" 200 None
2026-03-20 10:20:12 [auto1.nl] INFO: Saving data for JR69435: {'created_time': 1774002012.92541, 'last_price_update_time': 1774002012.925422, 'auction_closing_time': 1774109504.0}
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JR69435') HTTP/1.1" 204 0
2026-03-20 10:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_910e1af17a4f4d97dcdbacc165437a85.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b44910>
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F01%252F2d01c73bfe6a6011a53d4100afa0b74a%252Fpa%252FWF53810_f68dcfd25cdeb5b8b18d529b786ff517.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_f68dcfd25cdeb5b8b18d529b786ff517.jpg saved to cache
2026-03-20 10:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3f94d16-b21a-5021-86da-f5bf1370d6ab
2026-03-20 10:20:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3f94d16-b21a-5021-86da-f5bf1370d6ab, skipping ID generation
2026-03-20 10:20:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3f94d16-b21a-5021-86da-f5bf1370d6ab with scrape type 1
2026-03-20 10:20:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3f94d16-b21a-5021-86da-f5bf1370d6ab sending to next pipeline
2026-03-20 10:20:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e3f94d16-b21a-5021-86da-f5bf1370d6ab, identifier: WF53810
2026-03-20 10:20:13 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 1055 | hits on page: 40
2026-03-20 10:20:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-20 10:20:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with scrape type 1
2026-03-20 10:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F02%252Fca0228bf6bee847877326db446925b1a%252Fpa%252FHJ37238_ca8a4f0350e559f9a8b7d43954fe5a29.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_ca8a4f0350e559f9a8b7d43954fe5a29.jpg not downloaded yet
2026-03-20 10:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL17595/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e3f94d16-b21a-5021-86da-f5bf1370d6ab with identifier: WF53810
2026-03-20 10:20:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e3f94d16-b21a-5021-86da-f5bf1370d6ab with identifier: WF53810
2026-03-20 10:20:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e3f94d16-b21a-5021-86da-f5bf1370d6ab with identifier: WF53810 to the API
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_f68dcfd25cdeb5b8b18d529b786ff517.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-21T16:31:34Z',
 'fuel_type': 'diesel',
 'id': 'e3f94d16-b21a-5021-86da-f5bf1370d6ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF53810',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Kia',
 'model': 'Stinger',
 'odometer': 117364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34889,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_64ff8a071cc47369abc771b98b3e332f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33374,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_6d4833d3056555875a094b9b2b1e0656.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34403,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_ec560bdc2e1398f6692aeee89ea4043d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34109,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_384cbea345a44d0852cea6ef6c0c2622.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48527,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_28309fa32ea09e112e86558595ee5e09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56017,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_598838b6ecf5202129904325e3f54843.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50690,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_f303aadbbc17903ffb70ed294c013e13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f94d16-b21a-5021-86da-f5bf1370d6ab/e3f94d16-b21a-5021-86da-f5bf1370d6ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45086,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/01/2d01c73bfe6a6011a53d4100afa0b74a/pa/WF53810_f68dcfd25cdeb5b8b18d529b786ff517.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stinger 2.2 CRDi GT-Line 2WD',
 'transmission': 'automatic',
 'trim': 'GT-Line 2WD',
 'year': 2018}
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF53810%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Saving data for WF53810: {'created_time': 1774002013.711789, 'last_price_update_time': 1774002013.7118, 'auction_closing_time': 1774110694.0}
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WF53810') HTTP/1.1" 204 0
2026-03-20 10:20:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: SL76431
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL76431%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for SL76431: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV96248%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for PV96248: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for PY55457: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS22669%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for AS22669: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: XG91481
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG91481%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for XG91481: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: AK57667
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK57667%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for AK57667: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: FJ71499
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ71499%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for FJ71499: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: XW64325
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW64325%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for XW64325: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: EM31499
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM31499%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for EM31499: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: CK91738
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK91738%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for CK91738: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-20 10:20:13 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-20 10:20:13 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP47777%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for BP47777: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB20368%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for FB20368: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: PZ28248
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ28248%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for PZ28248: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: FZ51761
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ51761%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for FZ51761: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for AJ89396: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for ZR54060: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: ME22132
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME22132%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for ME22132: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for YZ13462: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for VV23298: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for FL02627: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TK93788%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for TK93788: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP13228%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for CP13228: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for EX94963: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for MW44280: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for EW45242: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for VH01672: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for MV10901: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ87592%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for YZ87592: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: XU05010
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU05010%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for XU05010: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: XG51270
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG51270%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for XG51270: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: CH53022
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH53022%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for CH53022: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ43979%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for JJ43979: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: EP28294
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP28294%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for EP28294: 0
2026-03-20 10:20:14 [auto1.nl] INFO: Found listing with ID: TU30248
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU30248%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [auto1.nl] INFO: Scrape type for TU30248: 0
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F02%252Fca0228bf6bee847877326db446925b1a%252Fpa%252FHJ37238_2787c30a39efba5082a5e2b54fda166d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_2787c30a39efba5082a5e2b54fda166d.jpg not downloaded yet
2026-03-20 10:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL62250> (referer: https://www.auto1.com/v1/car-details-view/UL62250/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4 with identifier: CF94302
2026-03-20 10:20:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4 with scrape type 1
2026-03-20 10:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_e86bcd32077a7686906471caaf140593.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_e86bcd32077a7686906471caaf140593.jpg not downloaded yet
2026-03-20 10:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81be5e10>
2026-03-20 10:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_9854812064e10a0b340915dd49029f2f.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_9854812064e10a0b340915dd49029f2f.jpg saved to cache
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf819df110>
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_3530a5b1184b9c82fd333e86a11128d3.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_3530a5b1184b9c82fd333e86a11128d3.jpg saved to cache
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80eed1d0>
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F7d%252Fdd7d89804aa1ab5ea82d6f56268b523e%252Fpa%252FNB80736_9c056d3e226408e6df3c685fe32a74a0.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_9c056d3e226408e6df3c685fe32a74a0.jpg saved to cache
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e
2026-03-20 10:20:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e, skipping ID generation
2026-03-20 10:20:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e with scrape type 1
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e sending to next pipeline
2026-03-20 10:20:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e, identifier: NB80736
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80de8610>
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F71%252F4b71296fb7e97f0f8eb34ef3d436c613%252Fpa%252FHT83355_910e1af17a4f4d97dcdbacc165437a85.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_910e1af17a4f4d97dcdbacc165437a85.jpg saved to cache
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f
2026-03-20 10:20:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 038e79aa-dfe9-5839-86ee-67e93f8a8d0f, skipping ID generation
2026-03-20 10:20:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f with scrape type 1
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 038e79aa-dfe9-5839-86ee-67e93f8a8d0f sending to next pipeline
2026-03-20 10:20:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 038e79aa-dfe9-5839-86ee-67e93f8a8d0f, identifier: HT83355
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F02%252Fca0228bf6bee847877326db446925b1a%252Fpa%252FHJ37238_40de7efcc0315f1f9610553d515dccc4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_40de7efcc0315f1f9610553d515dccc4.jpg not downloaded yet
2026-03-20 10:20:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e with identifier: NB80736
2026-03-20 10:20:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e with identifier: NB80736
2026-03-20 10:20:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 87b4f220-ef3a-5d3d-ac6b-8b494173ff3e with identifier: NB80736 to the API
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_9c056d3e226408e6df3c685fe32a74a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-21T16:14:13Z',
 'fuel_type': 'diesel',
 'id': '87b4f220-ef3a-5d3d-ac6b-8b494173ff3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB80736',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 198461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38432,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_3530a5b1184b9c82fd333e86a11128d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41517,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_b11d396ebb5f9c44ab33e4e61a6c599b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64448,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_9c056d3e226408e6df3c685fe32a74a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69526,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_2b0a67c5bf8a38450f9a39d48df3a293.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61844,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_57091dae45624362a83ba3e4a00b989b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87b4f220-ef3a-5d3d-ac6b-8b494173ff3e/87b4f220-ef3a-5d3d-ac6b-8b494173ff3e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52576,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/7d/dd7d89804aa1ab5ea82d6f56268b523e/pa/NB80736_9854812064e10a0b340915dd49029f2f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-09',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten lang FWD',
 'transmission': 'manual',
 'trim': 'Kasten lang FWD',
 'year': 2023}
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB80736%27 HTTP/1.1" 200 None
2026-03-20 10:20:15 [auto1.nl] INFO: Saving data for NB80736: {'created_time': 1774002015.999485, 'last_price_update_time': 1774002015.999496, 'auction_closing_time': 1774109653.0}
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NB80736') HTTP/1.1" 204 0
2026-03-20 10:20:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 038e79aa-dfe9-5839-86ee-67e93f8a8d0f with identifier: HT83355
2026-03-20 10:20:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 038e79aa-dfe9-5839-86ee-67e93f8a8d0f with identifier: HT83355
2026-03-20 10:20:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 038e79aa-dfe9-5839-86ee-67e93f8a8d0f with identifier: HT83355 to the API
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_910e1af17a4f4d97dcdbacc165437a85.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-21T16:27:43Z',
 'fuel_type': 'petrol',
 'id': '038e79aa-dfe9-5839-86ee-67e93f8a8d0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'NL197D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT83355',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 223210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_5b495824003abf14ca6f26af2514f78d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_50be1a00eaf266f88b979f43dab7688c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_aeabb14857674a3d51c4cf52980fe7c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_bd5c31a94f15ae09e8035530f20f0a1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_572d957f212db9a89578d03ab7e7cbd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_910e1af17a4f4d97dcdbacc165437a85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_3fd548bca1ab2f3739d10de4780f0b87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_fc0f7a66000594db012503d01326cd77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_9b554d6d0b9910935a7b9d5fff28e045.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_038e79aa-dfe9-5839-86ee-67e93f8a8d0f/038e79aa-dfe9-5839-86ee-67e93f8a8d0f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/71/4b71296fb7e97f0f8eb34ef3d436c613/pa/HT83355_65f4b7f0e92d1e7d02b307cfd2bc8654.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT83355%27 HTTP/1.1" 200 None
2026-03-20 10:20:16 [auto1.nl] INFO: Saving data for HT83355: {'created_time': 1774002016.736699, 'last_price_update_time': 1774002016.736714, 'auction_closing_time': 1774110463.0}
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT83355') HTTP/1.1" 204 0
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_aeb6154c021f97fbed45928132480e38.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_aeb6154c021f97fbed45928132480e38.jpg not downloaded yet
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F02%252Fca0228bf6bee847877326db446925b1a%252Fpa%252FHJ37238_9be30a396e33856f2477a1bdc7b96907.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_9be30a396e33856f2477a1bdc7b96907.jpg not downloaded yet
2026-03-20 10:20:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 203be145-659b-5915-95f2-aac6c1f6bb8c with identifier: UL62250
2026-03-20 10:20:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 203be145-659b-5915-95f2-aac6c1f6bb8c with scrape type 1
2026-03-20 10:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_0208881ab9e7ce165e1c91758315e395.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_0208881ab9e7ce165e1c91758315e395.jpg not downloaded yet
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_34d59f0875a9cf334679488b53c5a841.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_34d59f0875a9cf334679488b53c5a841.jpg not downloaded yet
2026-03-20 10:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW32477> (referer: https://www.auto1.com/v1/car-details-view/HW32477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF34624> (referer: https://www.auto1.com/v1/car-details-view/CF34624/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS60646> (referer: https://www.auto1.com/v1/car-details-view/JS60646/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_ca8a4f0350e559f9a8b7d43954fe5a29.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_64855f5086174e40231f460bb6f2a445.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_64855f5086174e40231f460bb6f2a445.jpg not downloaded yet
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_3bcc39149b35eebee0c9800680c9e06b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_3bcc39149b35eebee0c9800680c9e06b.jpg not downloaded yet
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_eb68285e6d96c0ee08dfd8e6d4545e83.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_eb68285e6d96c0ee08dfd8e6d4545e83.jpg not downloaded yet
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_91d9ee0381666eb7cc625cb2c215f34c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_91d9ee0381666eb7cc625cb2c215f34c.jpg not downloaded yet
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_560ead89806cb99aa16b19933e10ae73.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_560ead89806cb99aa16b19933e10ae73.jpg not downloaded yet
2026-03-20 10:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_0208881ab9e7ce165e1c91758315e395.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_22a7eb79ed08ebb49a4f88cc26be1f2e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_22a7eb79ed08ebb49a4f88cc26be1f2e.jpg not downloaded yet
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_f3b0a3f2b4bd0520c425d819ec73b0ee.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_f3b0a3f2b4bd0520c425d819ec73b0ee.jpg not downloaded yet
2026-03-20 10:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_aeb6154c021f97fbed45928132480e38.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_467cd7f59aa636708985b84660349523.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_467cd7f59aa636708985b84660349523.jpg not downloaded yet
2026-03-20 10:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_9be30a396e33856f2477a1bdc7b96907.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_486dde706a9ff451c5de81209b1c76ee.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_486dde706a9ff451c5de81209b1c76ee.jpg not downloaded yet
2026-03-20 10:20:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ef139a-0086-5467-ad5e-c3447bf0ca93 with identifier: HW32477
2026-03-20 10:20:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ef139a-0086-5467-ad5e-c3447bf0ca93 with scrape type 1
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 14ef139a-0086-5467-ad5e-c3447bf0ca93
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff7%252F6ef7b19fb5f31ee37daea8de0ce6c3c2%252Fpa%252FHW32477_e65e7eb59b15ed85686bf78b9025cb10.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_e65e7eb59b15ed85686bf78b9025cb10.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff7%252F6ef7b19fb5f31ee37daea8de0ce6c3c2%252Fpa%252FHW32477_45621d010b1ab812eeae184748d5d383.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_45621d010b1ab812eeae184748d5d383.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff7%252F6ef7b19fb5f31ee37daea8de0ce6c3c2%252Fpa%252FHW32477_51ee07a1b2b68fcceec25beb3711ff75.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_51ee07a1b2b68fcceec25beb3711ff75.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff7%252F6ef7b19fb5f31ee37daea8de0ce6c3c2%252Fpa%252FHW32477_d27fdb4ea3479195a65d2e88395f75b6.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_d27fdb4ea3479195a65d2e88395f75b6.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff7%252F6ef7b19fb5f31ee37daea8de0ce6c3c2%252Fpa%252FHW32477_297e3bdbbf10ab6214821df023748c7e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_297e3bdbbf10ab6214821df023748c7e.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff7%252F6ef7b19fb5f31ee37daea8de0ce6c3c2%252Fpa%252FHW32477_1534e66d5b5a5ca17c74e8ac792792ff.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_1534e66d5b5a5ca17c74e8ac792792ff.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff7%252F6ef7b19fb5f31ee37daea8de0ce6c3c2%252Fpa%252FHW32477_85d83eeb573334f281b162ba3edd33db.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_85d83eeb573334f281b162ba3edd33db.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff7%252F6ef7b19fb5f31ee37daea8de0ce6c3c2%252Fpa%252FHW32477_b398c99bd41f5ddbbcad7b7358cab097.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_b398c99bd41f5ddbbcad7b7358cab097.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff7%252F6ef7b19fb5f31ee37daea8de0ce6c3c2%252Fpa%252FHW32477_700a1d86e149913cc8395c183039dff9.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_700a1d86e149913cc8395c183039dff9.jpg already downloaded
2026-03-20 10:20:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14ef139a-0086-5467-ad5e-c3447bf0ca93, identifier: HW32477
2026-03-20 10:20:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab with identifier: CF34624
2026-03-20 10:20:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab with scrape type 1
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F68%252F0468f486ef22f28eb67c2975dd28dbf8%252Fpa%252FCF34624_d71a906138c0d588e97b711ff3434748.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_d71a906138c0d588e97b711ff3434748.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F68%252F0468f486ef22f28eb67c2975dd28dbf8%252Fpa%252FCF34624_c05f6fb40f4bf55140a0acf4609b1923.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_c05f6fb40f4bf55140a0acf4609b1923.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F68%252F0468f486ef22f28eb67c2975dd28dbf8%252Fpa%252FCF34624_15c1eb8dec5e34d11f05bbc3d02a89ee.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_15c1eb8dec5e34d11f05bbc3d02a89ee.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F68%252F0468f486ef22f28eb67c2975dd28dbf8%252Fpa%252FCF34624_289e3c5257acaea50dbc6e0bd3c5f6b5.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_289e3c5257acaea50dbc6e0bd3c5f6b5.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F68%252F0468f486ef22f28eb67c2975dd28dbf8%252Fpa%252FCF34624_a0c1d895e5da67e7f2642030f71e9b10.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_a0c1d895e5da67e7f2642030f71e9b10.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F68%252F0468f486ef22f28eb67c2975dd28dbf8%252Fpa%252FCF34624_ced7b0c9bbbe4684a6a64bb74c42c360.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_ced7b0c9bbbe4684a6a64bb74c42c360.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F68%252F0468f486ef22f28eb67c2975dd28dbf8%252Fpa%252FCF34624_751712dfaf6ab590f6463ff5796c5470.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_751712dfaf6ab590f6463ff5796c5470.jpg already downloaded
2026-03-20 10:20:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab, identifier: CF34624
2026-03-20 10:20:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8402d62e-24df-511a-8188-614e61878b68 with identifier: JS60646
2026-03-20 10:20:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8402d62e-24df-511a-8188-614e61878b68 with scrape type 1
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8402d62e-24df-511a-8188-614e61878b68
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_233bd93f6a8d4d2800b6bcdb66f9428d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_233bd93f6a8d4d2800b6bcdb66f9428d.jpg already downloaded
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_3a2ed0ac856d5a938ae6b049dba628e4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_3a2ed0ac856d5a938ae6b049dba628e4.jpg not downloaded yet
2026-03-20 10:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80eee890>
2026-03-20 10:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c01f0-6dff-59e4-b78f-b7bd6be80c04/473c01f0-6dff-59e4-b78f-b7bd6be80c04_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F02%252Fca0228bf6bee847877326db446925b1a%252Fpa%252FHJ37238_ca8a4f0350e559f9a8b7d43954fe5a29.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_ca8a4f0350e559f9a8b7d43954fe5a29.jpg saved to cache
2026-03-20 10:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04
2026-03-20 10:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_91d9ee0381666eb7cc625cb2c215f34c.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_dcc5ca2cd144bf0fa2137f8d8548aaa2.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_dcc5ca2cd144bf0fa2137f8d8548aaa2.jpg not downloaded yet
2026-03-20 10:20:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14ef139a-0086-5467-ad5e-c3447bf0ca93 with identifier: HW32477
2026-03-20 10:20:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14ef139a-0086-5467-ad5e-c3447bf0ca93 with identifier: HW32477
2026-03-20 10:20:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14ef139a-0086-5467-ad5e-c3447bf0ca93 with identifier: HW32477 to the API
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HW32477>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '',
 'engine_horse_power': 118,
 'expiration_date': '2026-03-21T16:54:50Z',
 'fuel_type': 'electro',
 'id': '14ef139a-0086-5467-ad5e-c3447bf0ca93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW32477',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 89288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 9,
 'photo_urls': ['https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_e65e7eb59b15ed85686bf78b9025cb10.jpg',
                'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_45621d010b1ab812eeae184748d5d383.jpg',
                'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_51ee07a1b2b68fcceec25beb3711ff75.jpg',
                'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_d27fdb4ea3479195a65d2e88395f75b6.jpg',
                'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_297e3bdbbf10ab6214821df023748c7e.jpg',
                'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_1534e66d5b5a5ca17c74e8ac792792ff.jpg',
                'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_85d83eeb573334f281b162ba3edd33db.jpg',
                'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_b398c99bd41f5ddbbcad7b7358cab097.jpg',
                'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_700a1d86e149913cc8395c183039dff9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14ef139a-0086-5467-ad5e-c3447bf0ca93/14ef139a-0086-5467-ad5e-c3447bf0ca93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292164,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_e65e7eb59b15ed85686bf78b9025cb10.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14ef139a-0086-5467-ad5e-c3447bf0ca93/14ef139a-0086-5467-ad5e-c3447bf0ca93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307555,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_45621d010b1ab812eeae184748d5d383.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14ef139a-0086-5467-ad5e-c3447bf0ca93/14ef139a-0086-5467-ad5e-c3447bf0ca93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36517,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_51ee07a1b2b68fcceec25beb3711ff75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14ef139a-0086-5467-ad5e-c3447bf0ca93/14ef139a-0086-5467-ad5e-c3447bf0ca93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33922,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_d27fdb4ea3479195a65d2e88395f75b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14ef139a-0086-5467-ad5e-c3447bf0ca93/14ef139a-0086-5467-ad5e-c3447bf0ca93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273188,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_297e3bdbbf10ab6214821df023748c7e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14ef139a-0086-5467-ad5e-c3447bf0ca93/14ef139a-0086-5467-ad5e-c3447bf0ca93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386214,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_1534e66d5b5a5ca17c74e8ac792792ff.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14ef139a-0086-5467-ad5e-c3447bf0ca93/14ef139a-0086-5467-ad5e-c3447bf0ca93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353748,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_85d83eeb573334f281b162ba3edd33db.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14ef139a-0086-5467-ad5e-c3447bf0ca93/14ef139a-0086-5467-ad5e-c3447bf0ca93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357452,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_b398c99bd41f5ddbbcad7b7358cab097.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14ef139a-0086-5467-ad5e-c3447bf0ca93/14ef139a-0086-5467-ad5e-c3447bf0ca93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244541,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f7/6ef7b19fb5f31ee37daea8de0ce6c3c2/pa/HW32477_700a1d86e149913cc8395c183039dff9.jpg',
             'Width': 1920}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32477%27 HTTP/1.1" 200 None
2026-03-20 10:20:18 [auto1.nl] INFO: Saving data for HW32477: {'created_time': 1774002018.401026, 'last_price_update_time': 1774002018.401037, 'auction_closing_time': 1774112090.0}
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HW32477') HTTP/1.1" 204 0
2026-03-20 10:20:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab with identifier: CF34624
2026-03-20 10:20:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab with identifier: CF34624
2026-03-20 10:20:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab with identifier: CF34624 to the API
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CF34624>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-21T16:49:30Z',
 'fuel_type': 'electro',
 'id': '3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF34624',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'EQA',
 'odometer': 147431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photo_urls': ['https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_d71a906138c0d588e97b711ff3434748.jpg',
                'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_c05f6fb40f4bf55140a0acf4609b1923.jpg',
                'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_15c1eb8dec5e34d11f05bbc3d02a89ee.jpg',
                'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_289e3c5257acaea50dbc6e0bd3c5f6b5.jpg',
                'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_a0c1d895e5da67e7f2642030f71e9b10.jpg',
                'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_ced7b0c9bbbe4684a6a64bb74c42c360.jpg',
                'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_751712dfaf6ab590f6463ff5796c5470.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab/3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33982,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_d71a906138c0d588e97b711ff3434748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab/3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33329,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_c05f6fb40f4bf55140a0acf4609b1923.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab/3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34391,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_15c1eb8dec5e34d11f05bbc3d02a89ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab/3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33820,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_289e3c5257acaea50dbc6e0bd3c5f6b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab/3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39628,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_a0c1d895e5da67e7f2642030f71e9b10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab/3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59008,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_ced7b0c9bbbe4684a6a64bb74c42c360.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab/3ba26eff-001c-59c9-a73a-a8b5c1dbb0ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45230,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img04/68/0468f486ef22f28eb67c2975dd28dbf8/pa/CF34624_751712dfaf6ab590f6463ff5796c5470.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz EQA 250 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF34624%27 HTTP/1.1" 200 None
2026-03-20 10:20:18 [auto1.nl] INFO: Saving data for CF34624: {'created_time': 1774002018.781774, 'last_price_update_time': 1774002018.781787, 'auction_closing_time': 1774111770.0}
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CF34624') HTTP/1.1" 204 0
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_9454b1d4a1f8e7a07ee4065b85cc2783.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_9454b1d4a1f8e7a07ee4065b85cc2783.jpg not downloaded yet
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_579bd6eae883a5615f9a5245d8197e04.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_579bd6eae883a5615f9a5245d8197e04.jpg not downloaded yet
2026-03-20 10:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81bbad50>
2026-03-20 10:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_0208881ab9e7ce165e1c91758315e395.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_0208881ab9e7ce165e1c91758315e395.jpg saved to cache
2026-03-20 10:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_4ba2c30532d6acba0d037aad6b6f4ff6.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_4ba2c30532d6acba0d037aad6b6f4ff6.jpg not downloaded yet
2026-03-20 10:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG36206> (referer: https://www.auto1.com/v1/car-details-view/RG36206/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ65934> (referer: https://www.auto1.com/v1/car-details-view/YZ65934/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d6ccd0>
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_aeb6154c021f97fbed45928132480e38.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_aeb6154c021f97fbed45928132480e38.jpg saved to cache
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e5f410>
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c01f0-6dff-59e4-b78f-b7bd6be80c04/473c01f0-6dff-59e4-b78f-b7bd6be80c04_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F02%252Fca0228bf6bee847877326db446925b1a%252Fpa%252FHJ37238_9be30a396e33856f2477a1bdc7b96907.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_9be30a396e33856f2477a1bdc7b96907.jpg saved to cache
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_cea915b7fb200d9c5b522e5a4b5437a8.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_cea915b7fb200d9c5b522e5a4b5437a8.jpg not downloaded yet
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_61d45cf2e42f92419bc82b315df0ba01.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_61d45cf2e42f92419bc82b315df0ba01.jpg not downloaded yet
2026-03-20 10:20:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_22a7eb79ed08ebb49a4f88cc26be1f2e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_70fdd117108da796c6a8b0c73f9b6fa5.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_70fdd117108da796c6a8b0c73f9b6fa5.jpg not downloaded yet
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d6dc50>
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_91d9ee0381666eb7cc625cb2c215f34c.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_91d9ee0381666eb7cc625cb2c215f34c.jpg saved to cache
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_467cd7f59aa636708985b84660349523.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_f3b0a3f2b4bd0520c425d819ec73b0ee.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_35e595e1c55859c6b1e068eb08c67570.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_35e595e1c55859c6b1e068eb08c67570.jpg not downloaded yet
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_61b674b3181596630e9a979288777a29.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_61b674b3181596630e9a979288777a29.jpg not downloaded yet
2026-03-20 10:20:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6 with identifier: RG36206
2026-03-20 10:20:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6 with scrape type 1
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fac%252F54ac949e679cbf236a3f730fa18404f1%252Fpa%252FRG36206_fc16b1541be49bd1e6688a4818930ba2.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_fc16b1541be49bd1e6688a4818930ba2.jpg already downloaded
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fac%252F54ac949e679cbf236a3f730fa18404f1%252Fpa%252FRG36206_e3440cd769830cef79ed24eeadc2684e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_e3440cd769830cef79ed24eeadc2684e.jpg already downloaded
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fac%252F54ac949e679cbf236a3f730fa18404f1%252Fpa%252FRG36206_b5552476ecaf400e07617af065601cc6.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_b5552476ecaf400e07617af065601cc6.jpg already downloaded
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fac%252F54ac949e679cbf236a3f730fa18404f1%252Fpa%252FRG36206_e7f743a33e04e2162368c37a57fe4182.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_e7f743a33e04e2162368c37a57fe4182.jpg already downloaded
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fac%252F54ac949e679cbf236a3f730fa18404f1%252Fpa%252FRG36206_6326f4c5103b1ca161aa0170238a446f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_6326f4c5103b1ca161aa0170238a446f.jpg already downloaded
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fac%252F54ac949e679cbf236a3f730fa18404f1%252Fpa%252FRG36206_7297bcad7ac9ff688bc69225263349ae.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_7297bcad7ac9ff688bc69225263349ae.jpg already downloaded
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fac%252F54ac949e679cbf236a3f730fa18404f1%252Fpa%252FRG36206_ada4fd4bbf522873aa090e4d695e8563.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_ada4fd4bbf522873aa090e4d695e8563.jpg already downloaded
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fac%252F54ac949e679cbf236a3f730fa18404f1%252Fpa%252FRG36206_8b0c19dd649397fa3d598bed89ec570c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_8b0c19dd649397fa3d598bed89ec570c.jpg already downloaded
2026-03-20 10:20:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6, identifier: RG36206
2026-03-20 10:20:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c386ca-8b8d-5062-9f50-5dc24d4606f5 with identifier: YZ65934
2026-03-20 10:20:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5 with scrape type 1
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_da17158c82fb5e5b846822e0291a127c.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_da17158c82fb5e5b846822e0291a127c.jpg not downloaded yet
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_b0b6f7a26dc54c22488b562b5ab111db.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_b0b6f7a26dc54c22488b562b5ab111db.jpg not downloaded yet
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_5e146d8614a2b0bb42d1fcde662f74d2.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_5e146d8614a2b0bb42d1fcde662f74d2.jpg not downloaded yet
2026-03-20 10:20:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6 with identifier: RG36206
2026-03-20 10:20:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6 with identifier: RG36206
2026-03-20 10:20:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6 with identifier: RG36206 to the API
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG36206>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 179,
 'expiration_date': '2026-03-21T16:35:20Z',
 'fuel_type': 'electro',
 'id': 'e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG36206',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 71877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photo_urls': ['https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_fc16b1541be49bd1e6688a4818930ba2.jpg',
                'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_e3440cd769830cef79ed24eeadc2684e.jpg',
                'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_b5552476ecaf400e07617af065601cc6.jpg',
                'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_e7f743a33e04e2162368c37a57fe4182.jpg',
                'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_6326f4c5103b1ca161aa0170238a446f.jpg',
                'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_7297bcad7ac9ff688bc69225263349ae.jpg',
                'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_ada4fd4bbf522873aa090e4d695e8563.jpg',
                'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_8b0c19dd649397fa3d598bed89ec570c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6/e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265732,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_fc16b1541be49bd1e6688a4818930ba2.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6/e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34828,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_e3440cd769830cef79ed24eeadc2684e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6/e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294762,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_b5552476ecaf400e07617af065601cc6.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6/e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36280,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_e7f743a33e04e2162368c37a57fe4182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6/e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335923,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_6326f4c5103b1ca161aa0170238a446f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6/e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65027,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_7297bcad7ac9ff688bc69225263349ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6/e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420708,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_ada4fd4bbf522873aa090e4d695e8563.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6/e7fdb7b7-f5b2-521d-ac7b-0f842f6777f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44055,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img54/ac/54ac949e679cbf236a3f730fa18404f1/pa/RG36206_8b0c19dd649397fa3d598bed89ec570c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Enyaq iV 60 Sportline',
 'transmission': 'automatic',
 'trim': 'Sportline',
 'year': 2021}
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG36206%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [auto1.nl] INFO: Saving data for RG36206: {'created_time': 1774002020.104889, 'last_price_update_time': 1774002020.104899, 'auction_closing_time': 1774110920.0}
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RG36206') HTTP/1.1" 204 0
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d7ae50>
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_22a7eb79ed08ebb49a4f88cc26be1f2e.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_22a7eb79ed08ebb49a4f88cc26be1f2e.jpg saved to cache
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_579bd6eae883a5615f9a5245d8197e04.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_4ba2c30532d6acba0d037aad6b6f4ff6.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_a7688a70fbbffb9129e74a7b01895478.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_a7688a70fbbffb9129e74a7b01895478.jpg not downloaded yet
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_61d45cf2e42f92419bc82b315df0ba01.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_9454b1d4a1f8e7a07ee4065b85cc2783.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_f0686884dd2361846cf9cd5f94cc06fe.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_f0686884dd2361846cf9cd5f94cc06fe.jpg already downloaded
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_da15113ec476d5bcf9e5557d217e5925.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_da15113ec476d5bcf9e5557d217e5925.jpg already downloaded
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_6f03b84ad690c58a63d60f70d0df2184.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_6f03b84ad690c58a63d60f70d0df2184.jpg already downloaded
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_6bf8ff1dd74f170b093ca6557bac2214.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_6bf8ff1dd74f170b093ca6557bac2214.jpg already downloaded
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf810938d0>
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_467cd7f59aa636708985b84660349523.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_467cd7f59aa636708985b84660349523.jpg saved to cache
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e354d0>
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_f3b0a3f2b4bd0520c425d819ec73b0ee.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_f3b0a3f2b4bd0520c425d819ec73b0ee.jpg saved to cache
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_cea915b7fb200d9c5b522e5a4b5437a8.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_1003ca8b9381899b0fd7989b37661a40.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_1003ca8b9381899b0fd7989b37661a40.jpg not downloaded yet
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC55043> (referer: https://www.auto1.com/v1/car-details-view/SC55043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW20864> (referer: https://www.auto1.com/v1/car-details-view/JW20864/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS15823> (referer: https://www.auto1.com/v1/car-details-view/JS15823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_95af000822b774adb1c0d2cf4bfae1f9.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_95af000822b774adb1c0d2cf4bfae1f9.jpg not downloaded yet
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81ba6dd0>
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_579bd6eae883a5615f9a5245d8197e04.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_579bd6eae883a5615f9a5245d8197e04.jpg saved to cache
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8402d62e-24df-511a-8188-614e61878b68
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80fed410>
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_4ba2c30532d6acba0d037aad6b6f4ff6.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_4ba2c30532d6acba0d037aad6b6f4ff6.jpg saved to cache
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81037d90>
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_61d45cf2e42f92419bc82b315df0ba01.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_61d45cf2e42f92419bc82b315df0ba01.jpg saved to cache
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8402d62e-24df-511a-8188-614e61878b68
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80de83d0>
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_9454b1d4a1f8e7a07ee4065b85cc2783.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_9454b1d4a1f8e7a07ee4065b85cc2783.jpg saved to cache
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_b0b6f7a26dc54c22488b562b5ab111db.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_5e146d8614a2b0bb42d1fcde662f74d2.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_ec94f221107d822e66797672d9d7c68d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_ec94f221107d822e66797672d9d7c68d.jpg not downloaded yet
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_da17158c82fb5e5b846822e0291a127c.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_61b674b3181596630e9a979288777a29.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_5b4a054a85cab3c5aaaeb6ed68a29348.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_5b4a054a85cab3c5aaaeb6ed68a29348.jpg not downloaded yet
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81092bd0>
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_cea915b7fb200d9c5b522e5a4b5437a8.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_cea915b7fb200d9c5b522e5a4b5437a8.jpg saved to cache
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae with identifier: SC55043
2026-03-20 10:20:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae with scrape type 1
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fd6%252Fddd6be0f02c8088b38d1e151c750b55f%252Fpa%252FSC55043_d09c49889b01b6749d39a710c70ab1f3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_d09c49889b01b6749d39a710c70ab1f3.jpg already downloaded
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fd6%252Fddd6be0f02c8088b38d1e151c750b55f%252Fpa%252FSC55043_6d981eb15b21620b0f368db9053705b2.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_6d981eb15b21620b0f368db9053705b2.jpg already downloaded
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fd6%252Fddd6be0f02c8088b38d1e151c750b55f%252Fpa%252FSC55043_59178eeea0f6936bd1077be5496952ef.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_59178eeea0f6936bd1077be5496952ef.jpg already downloaded
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fd6%252Fddd6be0f02c8088b38d1e151c750b55f%252Fpa%252FSC55043_3ffc94ca27b4ff29835d6f1f9c1d8749.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_3ffc94ca27b4ff29835d6f1f9c1d8749.jpg already downloaded
2026-03-20 10:20:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae, identifier: SC55043
2026-03-20 10:20:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864
2026-03-20 10:20:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with scrape type 1
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_82304582dd60138d54a20672e4a421a1.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_82304582dd60138d54a20672e4a421a1.jpg not downloaded yet
2026-03-20 10:20:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b773671f-c0a8-5188-bb3d-37c8915d6b99 with identifier: JS15823
2026-03-20 10:20:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b773671f-c0a8-5188-bb3d-37c8915d6b99 with scrape type 1
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_407b7adf444b93f5b4babfd75b714aa6.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_407b7adf444b93f5b4babfd75b714aa6.jpg not downloaded yet
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_a7688a70fbbffb9129e74a7b01895478.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae with identifier: SC55043
2026-03-20 10:20:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae with identifier: SC55043
2026-03-20 10:20:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae with identifier: SC55043 to the API
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC55043>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-21T16:51:48Z',
 'fuel_type': 'diesel',
 'id': '2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '38NFJ8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC55043',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 255417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photo_urls': ['https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_d09c49889b01b6749d39a710c70ab1f3.jpg',
                'https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_6d981eb15b21620b0f368db9053705b2.jpg',
                'https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_59178eeea0f6936bd1077be5496952ef.jpg',
                'https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_3ffc94ca27b4ff29835d6f1f9c1d8749.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae/2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_d09c49889b01b6749d39a710c70ab1f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae/2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_6d981eb15b21620b0f368db9053705b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae/2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_59178eeea0f6936bd1077be5496952ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae/2f44e21c-83dc-50d6-9bea-3d7b7c57f0ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/d6/ddd6be0f02c8088b38d1e151c750b55f/pa/SC55043_3ffc94ca27b4ff29835d6f1f9c1d8749.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2010}
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SC55043%27 HTTP/1.1" 200 None
2026-03-20 10:20:21 [auto1.nl] INFO: Saving data for SC55043: {'created_time': 1774002021.411983, 'last_price_update_time': 1774002021.411994, 'auction_closing_time': 1774111908.0}
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SC55043') HTTP/1.1" 204 0
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_70fdd117108da796c6a8b0c73f9b6fa5.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_dcc5ca2cd144bf0fa2137f8d8548aaa2.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_587ddac649fa1a7d8f368e82c9c4aa4f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_587ddac649fa1a7d8f368e82c9c4aa4f.jpg not downloaded yet
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_c2d9628a7522a10079f11b7f7f8af3df.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_c2d9628a7522a10079f11b7f7f8af3df.jpg not downloaded yet
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_3a2ed0ac856d5a938ae6b049dba628e4.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_35e595e1c55859c6b1e068eb08c67570.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_95af000822b774adb1c0d2cf4bfae1f9.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_1003ca8b9381899b0fd7989b37661a40.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_486dde706a9ff451c5de81209b1c76ee.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_0a862906da6542c0fc02480bc1575ccd.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_0a862906da6542c0fc02480bc1575ccd.jpg not downloaded yet
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_76da03559ee5dd9291e2de96ffa0fb57.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_76da03559ee5dd9291e2de96ffa0fb57.jpg not downloaded yet
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX17086> (referer: https://www.auto1.com/v1/car-details-view/GX17086/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f998d0>
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_b0b6f7a26dc54c22488b562b5ab111db.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_b0b6f7a26dc54c22488b562b5ab111db.jpg saved to cache
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81aacad0>
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_5e146d8614a2b0bb42d1fcde662f74d2.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_5e146d8614a2b0bb42d1fcde662f74d2.jpg saved to cache
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8402d62e-24df-511a-8188-614e61878b68
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81bf03d0>
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_da17158c82fb5e5b846822e0291a127c.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_da17158c82fb5e5b846822e0291a127c.jpg saved to cache
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80dd4fd0>
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_61b674b3181596630e9a979288777a29.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_61b674b3181596630e9a979288777a29.jpg saved to cache
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8402d62e-24df-511a-8188-614e61878b68
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e52c50>
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_a7688a70fbbffb9129e74a7b01895478.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_a7688a70fbbffb9129e74a7b01895478.jpg saved to cache
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_407b7adf444b93f5b4babfd75b714aa6.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_432638ac17139049b6af63ddcc44b537.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_432638ac17139049b6af63ddcc44b537.jpg not downloaded yet
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_446318a792a40ee9a22bfb2d750dcc87.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_446318a792a40ee9a22bfb2d750dcc87.jpg not downloaded yet
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_5b4a054a85cab3c5aaaeb6ed68a29348.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_82304582dd60138d54a20672e4a421a1.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81aac550>
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_70fdd117108da796c6a8b0c73f9b6fa5.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_70fdd117108da796c6a8b0c73f9b6fa5.jpg saved to cache
2026-03-20 10:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a95310>
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_dcc5ca2cd144bf0fa2137f8d8548aaa2.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_dcc5ca2cd144bf0fa2137f8d8548aaa2.jpg saved to cache
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80fb7450>
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F7c%252F3e7c58ee35c98d319f1380d94e83e2b4%252Fpa%252FJS60646_3a2ed0ac856d5a938ae6b049dba628e4.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_3a2ed0ac856d5a938ae6b049dba628e4.jpg saved to cache
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8402d62e-24df-511a-8188-614e61878b68
2026-03-20 10:20:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8402d62e-24df-511a-8188-614e61878b68, skipping ID generation
2026-03-20 10:20:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8402d62e-24df-511a-8188-614e61878b68 with scrape type 1
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8402d62e-24df-511a-8188-614e61878b68 sending to next pipeline
2026-03-20 10:20:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8402d62e-24df-511a-8188-614e61878b68, identifier: JS60646
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8196b950>
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_35e595e1c55859c6b1e068eb08c67570.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_35e595e1c55859c6b1e068eb08c67570.jpg saved to cache
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d6de50>
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_95af000822b774adb1c0d2cf4bfae1f9.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_95af000822b774adb1c0d2cf4bfae1f9.jpg saved to cache
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f6e150>
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_1003ca8b9381899b0fd7989b37661a40.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_1003ca8b9381899b0fd7989b37661a40.jpg saved to cache
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80ef2650>
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_486dde706a9ff451c5de81209b1c76ee.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_486dde706a9ff451c5de81209b1c76ee.jpg saved to cache
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f74753c4-e047-55ee-9898-95f2b5c0c501 with identifier: GX17086
2026-03-20 10:20:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f74753c4-e047-55ee-9898-95f2b5c0c501 with scrape type 1
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f74753c4-e047-55ee-9898-95f2b5c0c501
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F63%252Fdd63687d0f757a821d2a25a3195419cb%252Fpa%252FGX17086_8a6cd260d0c1c53a9659c2802089cf27.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_8a6cd260d0c1c53a9659c2802089cf27.jpg already downloaded
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F63%252Fdd63687d0f757a821d2a25a3195419cb%252Fpa%252FGX17086_4d1512ece2ad52adcf0dac0af632de5e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_4d1512ece2ad52adcf0dac0af632de5e.jpg already downloaded
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F63%252Fdd63687d0f757a821d2a25a3195419cb%252Fpa%252FGX17086_8809cc0dab406b09e2aa291594afc1b7.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_8809cc0dab406b09e2aa291594afc1b7.jpg already downloaded
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F63%252Fdd63687d0f757a821d2a25a3195419cb%252Fpa%252FGX17086_1e0401d46ff5400899512bd738d92140.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_1e0401d46ff5400899512bd738d92140.jpg already downloaded
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F63%252Fdd63687d0f757a821d2a25a3195419cb%252Fpa%252FGX17086_0210835ebc2c3b95a7302282fdd99a30.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_0210835ebc2c3b95a7302282fdd99a30.jpg already downloaded
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F63%252Fdd63687d0f757a821d2a25a3195419cb%252Fpa%252FGX17086_aa54681562ba97bb9a4596d0c4f2ba23.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_aa54681562ba97bb9a4596d0c4f2ba23.jpg already downloaded
2026-03-20 10:20:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f74753c4-e047-55ee-9898-95f2b5c0c501, identifier: GX17086
2026-03-20 10:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_560ead89806cb99aa16b19933e10ae73.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_3bcc39149b35eebee0c9800680c9e06b.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_5cb70430b6485bf735536f1b199687f9.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_5cb70430b6485bf735536f1b199687f9.jpg not downloaded yet
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_649a4b081f043ead42f08cb5d8e65925.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_649a4b081f043ead42f08cb5d8e65925.jpg not downloaded yet
2026-03-20 10:20:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8402d62e-24df-511a-8188-614e61878b68 with identifier: JS60646
2026-03-20 10:20:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8402d62e-24df-511a-8188-614e61878b68 with identifier: JS60646
2026-03-20 10:20:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8402d62e-24df-511a-8188-614e61878b68 with identifier: JS60646 to the API
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_3a2ed0ac856d5a938ae6b049dba628e4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-21T16:50:51Z',
 'fuel_type': 'petrol',
 'id': '8402d62e-24df-511a-8188-614e61878b68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '96pnh9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS60646',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 227915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_233bd93f6a8d4d2800b6bcdb66f9428d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_3a2ed0ac856d5a938ae6b049dba628e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_579bd6eae883a5615f9a5245d8197e04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_61d45cf2e42f92419bc82b315df0ba01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_61b674b3181596630e9a979288777a29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_5e146d8614a2b0bb42d1fcde662f74d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_f0686884dd2361846cf9cd5f94cc06fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_da15113ec476d5bcf9e5557d217e5925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_6f03b84ad690c58a63d60f70d0df2184.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8402d62e-24df-511a-8188-614e61878b68/8402d62e-24df-511a-8188-614e61878b68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/7c/3e7c58ee35c98d319f1380d94e83e2b4/pa/JS60646_6bf8ff1dd74f170b093ca6557bac2214.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2011}
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS60646%27 HTTP/1.1" 200 None
2026-03-20 10:20:23 [auto1.nl] INFO: Saving data for JS60646: {'created_time': 1774002023.058155, 'last_price_update_time': 1774002023.058165, 'auction_closing_time': 1774111851.0}
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JS60646') HTTP/1.1" 204 0
2026-03-20 10:20:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f74753c4-e047-55ee-9898-95f2b5c0c501 with identifier: GX17086
2026-03-20 10:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f74753c4-e047-55ee-9898-95f2b5c0c501 with identifier: GX17086
2026-03-20 10:20:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f74753c4-e047-55ee-9898-95f2b5c0c501 with identifier: GX17086 to the API
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GX17086>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-21T16:01:58Z',
 'fuel_type': 'diesel',
 'id': 'f74753c4-e047-55ee-9898-95f2b5c0c501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PS-294-G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX17086',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'BMW',
 'model': '1er',
 'odometer': 365858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_8a6cd260d0c1c53a9659c2802089cf27.jpg',
                'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_4d1512ece2ad52adcf0dac0af632de5e.jpg',
                'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_8809cc0dab406b09e2aa291594afc1b7.jpg',
                'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_1e0401d46ff5400899512bd738d92140.jpg',
                'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_0210835ebc2c3b95a7302282fdd99a30.jpg',
                'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_aa54681562ba97bb9a4596d0c4f2ba23.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74753c4-e047-55ee-9898-95f2b5c0c501/f74753c4-e047-55ee-9898-95f2b5c0c501_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_8a6cd260d0c1c53a9659c2802089cf27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74753c4-e047-55ee-9898-95f2b5c0c501/f74753c4-e047-55ee-9898-95f2b5c0c501_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_4d1512ece2ad52adcf0dac0af632de5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74753c4-e047-55ee-9898-95f2b5c0c501/f74753c4-e047-55ee-9898-95f2b5c0c501_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_8809cc0dab406b09e2aa291594afc1b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74753c4-e047-55ee-9898-95f2b5c0c501/f74753c4-e047-55ee-9898-95f2b5c0c501_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_1e0401d46ff5400899512bd738d92140.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74753c4-e047-55ee-9898-95f2b5c0c501/f74753c4-e047-55ee-9898-95f2b5c0c501_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_0210835ebc2c3b95a7302282fdd99a30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f74753c4-e047-55ee-9898-95f2b5c0c501/f74753c4-e047-55ee-9898-95f2b5c0c501_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/63/dd63687d0f757a821d2a25a3195419cb/pa/GX17086_aa54681562ba97bb9a4596d0c4f2ba23.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX17086%27 HTTP/1.1" 200 None
2026-03-20 10:20:23 [auto1.nl] INFO: Saving data for GX17086: {'created_time': 1774002023.427526, 'last_price_update_time': 1774002023.427536, 'auction_closing_time': 1774108918.0}
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GX17086') HTTP/1.1" 204 0
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_eb68285e6d96c0ee08dfd8e6d4545e83.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_ec94f221107d822e66797672d9d7c68d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_3fbc3f8518218b45b28646979bacd5be.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_3fbc3f8518218b45b28646979bacd5be.jpg not downloaded yet
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_9b30a79a15e1e743ab1825c604866f51.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_9b30a79a15e1e743ab1825c604866f51.jpg not downloaded yet
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL17595> (referer: https://www.auto1.com/v1/car-details-view/RL17595/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8196ad90>
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_407b7adf444b93f5b4babfd75b714aa6.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_407b7adf444b93f5b4babfd75b714aa6.jpg saved to cache
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c2f790>
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_5b4a054a85cab3c5aaaeb6ed68a29348.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_5b4a054a85cab3c5aaaeb6ed68a29348.jpg saved to cache
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c1a550>
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_82304582dd60138d54a20672e4a421a1.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_82304582dd60138d54a20672e4a421a1.jpg saved to cache
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_587ddac649fa1a7d8f368e82c9c4aa4f.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT74092> (referer: https://www.auto1.com/v1/car-details-view/MT74092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ12956> (referer: https://www.auto1.com/v1/car-details-view/UJ12956/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD85766> (referer: https://www.auto1.com/v1/car-details-view/GD85766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_c2d9628a7522a10079f11b7f7f8af3df.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_39b8ba409b33cfd04ace63874d19b68f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_39b8ba409b33cfd04ace63874d19b68f.jpg not downloaded yet
2026-03-20 10:20:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e22c90>
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_560ead89806cb99aa16b19933e10ae73.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_560ead89806cb99aa16b19933e10ae73.jpg saved to cache
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b20b50>
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_3bcc39149b35eebee0c9800680c9e06b.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_3bcc39149b35eebee0c9800680c9e06b.jpg saved to cache
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_432638ac17139049b6af63ddcc44b537.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_64855f5086174e40231f460bb6f2a445.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_aa507295c5afa73714a62cff5e945296.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_aa507295c5afa73714a62cff5e945296.jpg not downloaded yet
2026-03-20 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_0a862906da6542c0fc02480bc1575ccd.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d81290>
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_eb68285e6d96c0ee08dfd8e6d4545e83.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_eb68285e6d96c0ee08dfd8e6d4545e83.jpg saved to cache
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b05e50>
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F11%252Fa71103237b42878c7359e7b85aa91f6a%252Fpa%252FYZ65934_ec94f221107d822e66797672d9d7c68d.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_ec94f221107d822e66797672d9d7c68d.jpg saved to cache
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5
2026-03-20 10:20:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98c386ca-8b8d-5062-9f50-5dc24d4606f5, skipping ID generation
2026-03-20 10:20:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5 with scrape type 1
2026-03-20 10:20:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98c386ca-8b8d-5062-9f50-5dc24d4606f5 sending to next pipeline
2026-03-20 10:20:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 98c386ca-8b8d-5062-9f50-5dc24d4606f5, identifier: YZ65934
2026-03-20 10:20:24 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 1055 | hits on page: 40
2026-03-20 10:20:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 440e12e1-6f57-5e12-b6ba-3d5ed62a513c with identifier: RL17595
2026-03-20 10:20:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c with scrape type 1
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_7a286025aaede201986a53649ac17d9d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_7a286025aaede201986a53649ac17d9d.jpg not downloaded yet
2026-03-20 10:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b72d90>
2026-03-20 10:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_587ddac649fa1a7d8f368e82c9c4aa4f.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_587ddac649fa1a7d8f368e82c9c4aa4f.jpg saved to cache
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4
2026-03-20 10:20:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a46fcd-1407-5fb4-98a9-3c826dbccda7 with identifier: MT74092
2026-03-20 10:20:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7 with scrape type 1
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_347f876405f250beab6b6b4ebd1a753e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_347f876405f250beab6b6b4ebd1a753e.jpg not downloaded yet
2026-03-20 10:20:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d3f2d41-d20e-507d-befc-535074bab2b3 with identifier: UJ12956
2026-03-20 10:20:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d3f2d41-d20e-507d-befc-535074bab2b3 with scrape type 1
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5d3f2d41-d20e-507d-befc-535074bab2b3
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_fe5d9c27749557ef81acd054f0b422f4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_fe5d9c27749557ef81acd054f0b422f4.jpg not downloaded yet
2026-03-20 10:20:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b326251c-0e14-5130-83f0-07cea4f09500 with identifier: GD85766
2026-03-20 10:20:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b326251c-0e14-5130-83f0-07cea4f09500 with scrape type 1
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b326251c-0e14-5130-83f0-07cea4f09500
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_15ff9de470561696051b39ce1ccaa576.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_15ff9de470561696051b39ce1ccaa576.jpg not downloaded yet
2026-03-20 10:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf810180d0>
2026-03-20 10:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_c2d9628a7522a10079f11b7f7f8af3df.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_c2d9628a7522a10079f11b7f7f8af3df.jpg saved to cache
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_76da03559ee5dd9291e2de96ffa0fb57.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_446318a792a40ee9a22bfb2d750dcc87.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_34d59f0875a9cf334679488b53c5a841.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_3fbc3f8518218b45b28646979bacd5be.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_0f9d0c544e97c65c31e8e118d9833673.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_0f9d0c544e97c65c31e8e118d9833673.jpg not downloaded yet
2026-03-20 10:20:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 98c386ca-8b8d-5062-9f50-5dc24d4606f5 with identifier: YZ65934
2026-03-20 10:20:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 98c386ca-8b8d-5062-9f50-5dc24d4606f5 with identifier: YZ65934
2026-03-20 10:20:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 98c386ca-8b8d-5062-9f50-5dc24d4606f5 with identifier: YZ65934 to the API
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_ec94f221107d822e66797672d9d7c68d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-21T16:41:18Z',
 'fuel_type': 'petrol',
 'id': '98c386ca-8b8d-5062-9f50-5dc24d4606f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '89-RR-KB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ65934',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 184384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_da17158c82fb5e5b846822e0291a127c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_a7688a70fbbffb9129e74a7b01895478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_1003ca8b9381899b0fd7989b37661a40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_95af000822b774adb1c0d2cf4bfae1f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_ec94f221107d822e66797672d9d7c68d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98c386ca-8b8d-5062-9f50-5dc24d4606f5/98c386ca-8b8d-5062-9f50-5dc24d4606f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/11/a71103237b42878c7359e7b85aa91f6a/pa/YZ65934_5b4a054a85cab3c5aaaeb6ed68a29348.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-07-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Privilege',
 'transmission': 'automatic',
 'trim': 'Privilege',
 'year': 2005}
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ65934%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Saving data for YZ65934: {'created_time': 1774002024.746207, 'last_price_update_time': 1774002024.746221, 'auction_closing_time': 1774111278.0}
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ65934') HTTP/1.1" 204 0
2026-03-20 10:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_40de7efcc0315f1f9610553d515dccc4.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA29712%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for NA29712: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: VV57734
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV57734%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for VV57734: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: NG27768
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG27768%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for NG27768: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: PB13683
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB13683%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for PB13683: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for UB80121: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for PL67988: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: MN54197
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN54197%27 HTTP/1.1" 200 None
2026-03-20 10:20:24 [auto1.nl] INFO: Scrape type for MN54197: 0
2026-03-20 10:20:24 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for WY03082: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: PN36412
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN36412%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for PN36412: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV60983%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for YV60983: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: JG65435
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG65435%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for JG65435: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP94169%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for GP94169: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: DL26924
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL26924%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for DL26924: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX18772%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for VX18772: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: KK89684
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK89684%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for KK89684: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: JS60564
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS60564%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for JS60564: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: AV93319
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV93319%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for AV93319: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: FN85022
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FN85022%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for FN85022: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for WC63917: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: LZ20113
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ20113%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for LZ20113: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: JU41234
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JU41234%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for JU41234: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for JG60699: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: CH47579
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH47579%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for CH47579: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT82599%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for RT82599: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: HT16720
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16720%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for HT16720: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV80682%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for CV80682: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX21734%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for KX21734: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR09691%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for TR09691: 0
2026-03-20 10:20:25 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [auto1.nl] INFO: Scrape type for VM41876: 0
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_0b478de7fc1670ecbc0ee99106edd260.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_0b478de7fc1670ecbc0ee99106edd260.jpg not downloaded yet
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_980f529a8eb32c9131f66dffb2bf83a4.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_980f529a8eb32c9131f66dffb2bf83a4.jpg not downloaded yet
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_0932d0f73ec651cb3d36c19d98606431.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_0932d0f73ec651cb3d36c19d98606431.jpg not downloaded yet
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_8c0681f356c1071823a49c604ad5d5d1.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_8c0681f356c1071823a49c604ad5d5d1.jpg not downloaded yet
2026-03-20 10:20:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80ed6890>
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_432638ac17139049b6af63ddcc44b537.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_432638ac17139049b6af63ddcc44b537.jpg saved to cache
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf819a33d0>
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F66%252F7066a1b27ccd2b3ba4a33a224fdd60b8%252Fpa%252FUL62250_64855f5086174e40231f460bb6f2a445.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_64855f5086174e40231f460bb6f2a445.jpg saved to cache
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 203be145-659b-5915-95f2-aac6c1f6bb8c
2026-03-20 10:20:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 203be145-659b-5915-95f2-aac6c1f6bb8c, skipping ID generation
2026-03-20 10:20:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 203be145-659b-5915-95f2-aac6c1f6bb8c with scrape type 1
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 203be145-659b-5915-95f2-aac6c1f6bb8c sending to next pipeline
2026-03-20 10:20:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 203be145-659b-5915-95f2-aac6c1f6bb8c, identifier: UL62250
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f85110>
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_0a862906da6542c0fc02480bc1575ccd.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_0a862906da6542c0fc02480bc1575ccd.jpg saved to cache
2026-03-20 10:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4
2026-03-20 10:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_e86bcd32077a7686906471caaf140593.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_39b8ba409b33cfd04ace63874d19b68f.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_2787c30a39efba5082a5e2b54fda166d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_5cb70430b6485bf735536f1b199687f9.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_0ac903f0a27f2ae54f7671fdf1ea3ba2.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_0ac903f0a27f2ae54f7671fdf1ea3ba2.jpg not downloaded yet
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_51a1878121eff9a812accf1f870558f7.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_51a1878121eff9a812accf1f870558f7.jpg not downloaded yet
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_35d6c6f9fe5ed6ea89b93db0e53fa029.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_35d6c6f9fe5ed6ea89b93db0e53fa029.jpg not downloaded yet
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_c14b71136bf98222e88b52f30273b4a1.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_c14b71136bf98222e88b52f30273b4a1.jpg not downloaded yet
2026-03-20 10:20:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 203be145-659b-5915-95f2-aac6c1f6bb8c with identifier: UL62250
2026-03-20 10:20:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 203be145-659b-5915-95f2-aac6c1f6bb8c with identifier: UL62250
2026-03-20 10:20:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 203be145-659b-5915-95f2-aac6c1f6bb8c with identifier: UL62250 to the API
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_64855f5086174e40231f460bb6f2a445.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-21T16:03:33Z',
 'fuel_type': 'petrol',
 'id': '203be145-659b-5915-95f2-aac6c1f6bb8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'HBN54K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL62250',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 60610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_0208881ab9e7ce165e1c91758315e395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_64855f5086174e40231f460bb6f2a445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_eb68285e6d96c0ee08dfd8e6d4545e83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_560ead89806cb99aa16b19933e10ae73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_f3b0a3f2b4bd0520c425d819ec73b0ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_486dde706a9ff451c5de81209b1c76ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_9454b1d4a1f8e7a07ee4065b85cc2783.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_cea915b7fb200d9c5b522e5a4b5437a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_35e595e1c55859c6b1e068eb08c67570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_203be145-659b-5915-95f2-aac6c1f6bb8c/203be145-659b-5915-95f2-aac6c1f6bb8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/66/7066a1b27ccd2b3ba4a33a224fdd60b8/pa/UL62250_b0b6f7a26dc54c22488b562b5ab111db.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UL62250%27 HTTP/1.1" 200 None
2026-03-20 10:20:26 [auto1.nl] INFO: Saving data for UL62250: {'created_time': 1774002026.619918, 'last_price_update_time': 1774002026.619942, 'auction_closing_time': 1774109013.0}
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UL62250') HTTP/1.1" 204 0
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d81d90>
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_76da03559ee5dd9291e2de96ffa0fb57.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_76da03559ee5dd9291e2de96ffa0fb57.jpg saved to cache
2026-03-20 10:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83d4ccd0>
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_446318a792a40ee9a22bfb2d750dcc87.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_446318a792a40ee9a22bfb2d750dcc87.jpg saved to cache
2026-03-20 10:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81cd6d50>
2026-03-20 10:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_34d59f0875a9cf334679488b53c5a841.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_34d59f0875a9cf334679488b53c5a841.jpg saved to cache
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81019090>
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_3fbc3f8518218b45b28646979bacd5be.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_3fbc3f8518218b45b28646979bacd5be.jpg saved to cache
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e26050>
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c01f0-6dff-59e4-b78f-b7bd6be80c04/473c01f0-6dff-59e4-b78f-b7bd6be80c04_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F02%252Fca0228bf6bee847877326db446925b1a%252Fpa%252FHJ37238_40de7efcc0315f1f9610553d515dccc4.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_40de7efcc0315f1f9610553d515dccc4.jpg saved to cache
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04
2026-03-20 10:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_15ff9de470561696051b39ce1ccaa576.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_757170cde135deb92d8b0806b29c8d15.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_757170cde135deb92d8b0806b29c8d15.jpg not downloaded yet
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_f1ab2f480c9a454912a75c737e401787.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_f1ab2f480c9a454912a75c737e401787.jpg not downloaded yet
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_5d79d3c3a56f686ba907584a154a928e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_5d79d3c3a56f686ba907584a154a928e.jpg not downloaded yet
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_e43766cb3535dce1d7d4e729a9f229d3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_e43766cb3535dce1d7d4e729a9f229d3.jpg not downloaded yet
2026-03-20 10:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_7a286025aaede201986a53649ac17d9d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_532c5fd560df5f39d998bf4b78cf5f8f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_532c5fd560df5f39d998bf4b78cf5f8f.jpg not downloaded yet
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_c608c38e05eb350d4ac0a6440a3619d9.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_c608c38e05eb350d4ac0a6440a3619d9.jpg not downloaded yet
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_daf58056e8874e232177de708ce2e677.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_daf58056e8874e232177de708ce2e677.jpg not downloaded yet
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_2a9f8b8aa7e29456a32d86596177641a.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_2a9f8b8aa7e29456a32d86596177641a.jpg not downloaded yet
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83c09690>
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F91%252F0291b3582c058e3f22a49a5bd389554d%252Fpa%252FCF94302_e86bcd32077a7686906471caaf140593.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_e86bcd32077a7686906471caaf140593.jpg saved to cache
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4
2026-03-20 10:20:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4, skipping ID generation
2026-03-20 10:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4 with scrape type 1
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4 sending to next pipeline
2026-03-20 10:20:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4, identifier: CF94302
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83aae410>
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_39b8ba409b33cfd04ace63874d19b68f.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_39b8ba409b33cfd04ace63874d19b68f.jpg saved to cache
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81957c90>
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_473c01f0-6dff-59e4-b78f-b7bd6be80c04/473c01f0-6dff-59e4-b78f-b7bd6be80c04_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F02%252Fca0228bf6bee847877326db446925b1a%252Fpa%252FHJ37238_2787c30a39efba5082a5e2b54fda166d.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_2787c30a39efba5082a5e2b54fda166d.jpg saved to cache
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04
2026-03-20 10:20:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 473c01f0-6dff-59e4-b78f-b7bd6be80c04, skipping ID generation
2026-03-20 10:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with scrape type 1
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04 sending to next pipeline
2026-03-20 10:20:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 473c01f0-6dff-59e4-b78f-b7bd6be80c04, identifier: HJ37238
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83a7e3d0>
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F48%252F8c484d327b79a4122ccc4814a68a0d5b%252Fpa%252FJW20864_5cb70430b6485bf735536f1b199687f9.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_5cb70430b6485bf735536f1b199687f9.jpg saved to cache
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4
2026-03-20 10:20:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4, skipping ID generation
2026-03-20 10:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with scrape type 1
2026-03-20 10:20:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 sending to next pipeline
2026-03-20 10:20:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4, identifier: JW20864
2026-03-20 10:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_aa507295c5afa73714a62cff5e945296.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_fe5d9c27749557ef81acd054f0b422f4.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_347f876405f250beab6b6b4ebd1a753e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4 with identifier: CF94302
2026-03-20 10:20:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4 with identifier: CF94302
2026-03-20 10:20:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4 with identifier: CF94302 to the API
2026-03-20 10:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_e86bcd32077a7686906471caaf140593.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-21T16:17:25Z',
 'fuel_type': 'hybrid',
 'id': '637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF94302',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 157483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31107,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_e86bcd32077a7686906471caaf140593.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29195,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_aeb6154c021f97fbed45928132480e38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30419,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_34d59f0875a9cf334679488b53c5a841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28982,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_3bcc39149b35eebee0c9800680c9e06b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40222,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_91d9ee0381666eb7cc625cb2c215f34c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42572,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_22a7eb79ed08ebb49a4f88cc26be1f2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58494,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_467cd7f59aa636708985b84660349523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41700,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_dcc5ca2cd144bf0fa2137f8d8548aaa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47874,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_4ba2c30532d6acba0d037aad6b6f4ff6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4/637f1714-0c3f-51a2-b1ab-9a3c5a9f16b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42572,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img02/91/0291b3582c058e3f22a49a5bd389554d/pa/CF94302_70fdd117108da796c6a8b0c73f9b6fa5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI iV RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2021}
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF94302%27 HTTP/1.1" 200 None
2026-03-20 10:20:28 [auto1.nl] INFO: Saving data for CF94302: {'created_time': 1774002028.281179, 'last_price_update_time': 1774002028.281193, 'auction_closing_time': 1774109845.0}
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CF94302') HTTP/1.1" 204 0
2026-03-20 10:20:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-20 10:20:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-20 10:20:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238 to the API
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_2787c30a39efba5082a5e2b54fda166d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-21T16:28:30Z',
 'fuel_type': 'diesel',
 'id': '473c01f0-6dff-59e4-b78f-b7bd6be80c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'V611VF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ37238',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 229510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c01f0-6dff-59e4-b78f-b7bd6be80c04/473c01f0-6dff-59e4-b78f-b7bd6be80c04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_ca8a4f0350e559f9a8b7d43954fe5a29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c01f0-6dff-59e4-b78f-b7bd6be80c04/473c01f0-6dff-59e4-b78f-b7bd6be80c04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_2787c30a39efba5082a5e2b54fda166d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c01f0-6dff-59e4-b78f-b7bd6be80c04/473c01f0-6dff-59e4-b78f-b7bd6be80c04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_40de7efcc0315f1f9610553d515dccc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_473c01f0-6dff-59e4-b78f-b7bd6be80c04/473c01f0-6dff-59e4-b78f-b7bd6be80c04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/02/ca0228bf6bee847877326db446925b1a/pa/HJ37238_9be30a396e33856f2477a1bdc7b96907.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Compact Basis',
 'transmission': 'manual',
 'trim': 'Rapid Compact Basis',
 'year': 2019}
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-20 10:20:28 [auto1.nl] INFO: Saving data for HJ37238: {'created_time': 1774002028.690083, 'last_price_update_time': 1774002028.690093, 'auction_closing_time': 1774110510.0}
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HJ37238') HTTP/1.1" 204 0
2026-03-20 10:20:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864
2026-03-20 10:20:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864
2026-03-20 10:20:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4 with identifier: JW20864 to the API
2026-03-20 10:20:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_5cb70430b6485bf735536f1b199687f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-21T16:47:45Z',
 'fuel_type': 'petrol',
 'id': 'e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '62TTD6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW20864',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 178267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_82304582dd60138d54a20672e4a421a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_587ddac649fa1a7d8f368e82c9c4aa4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_0a862906da6542c0fc02480bc1575ccd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_432638ac17139049b6af63ddcc44b537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_5cb70430b6485bf735536f1b199687f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4/e4cf3c62-8c15-5b2f-9c02-77be18dc0dd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/48/8c484d327b79a4122ccc4814a68a0d5b/pa/JW20864_3fbc3f8518218b45b28646979bacd5be.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW20864%27 HTTP/1.1" 200 None
2026-03-20 10:20:29 [auto1.nl] INFO: Saving data for JW20864: {'created_time': 1774002029.492976, 'last_price_update_time': 1774002029.492988, 'auction_closing_time': 1774111665.0}
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JW20864') HTTP/1.1" 204 0
2026-03-20 10:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_9b30a79a15e1e743ab1825c604866f51.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_649a4b081f043ead42f08cb5d8e65925.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_8c0681f356c1071823a49c604ad5d5d1.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_e8d0729417c883098b60876df00df333.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_e8d0729417c883098b60876df00df333.jpg not downloaded yet
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_d310946fc2a16c81d8680f1f39b187ee.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_d310946fc2a16c81d8680f1f39b187ee.jpg not downloaded yet
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_81f93d40747de7f7356520c6d72c1de9.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_81f93d40747de7f7356520c6d72c1de9.jpg not downloaded yet
2026-03-20 10:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_0932d0f73ec651cb3d36c19d98606431.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV51543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_5ef8f8862afb6b3f8ade577fad87243b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_5ef8f8862afb6b3f8ade577fad87243b.jpg not downloaded yet
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_3da1ee787dd0a065120c46e5ae72a050.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_3da1ee787dd0a065120c46e5ae72a050.jpg not downloaded yet
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_83dd572065153f1654d0fe08791301d8.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_83dd572065153f1654d0fe08791301d8.jpg not downloaded yet
2026-03-20 10:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS83141> (referer: https://www.auto1.com/v1/car-details-view/TS83141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV81298> (referer: https://www.auto1.com/v1/car-details-view/NV81298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c2f9d0>
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_15ff9de470561696051b39ce1ccaa576.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_15ff9de470561696051b39ce1ccaa576.jpg saved to cache
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b326251c-0e14-5130-83f0-07cea4f09500
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d761d0>
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_7a286025aaede201986a53649ac17d9d.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_7a286025aaede201986a53649ac17d9d.jpg saved to cache
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b06890>
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_aa507295c5afa73714a62cff5e945296.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_aa507295c5afa73714a62cff5e945296.jpg saved to cache
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81bff790>
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_fe5d9c27749557ef81acd054f0b422f4.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_fe5d9c27749557ef81acd054f0b422f4.jpg saved to cache
2026-03-20 10:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d3f2d41-d20e-507d-befc-535074bab2b3
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b04710>
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_347f876405f250beab6b6b4ebd1a753e.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_347f876405f250beab6b6b4ebd1a753e.jpg saved to cache
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_532c5fd560df5f39d998bf4b78cf5f8f.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_08624fa79aef583e1687799d1b171956.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_08624fa79aef583e1687799d1b171956.jpg not downloaded yet
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_7a25141bd0c7533c24fd7ceebe44d752.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_7a25141bd0c7533c24fd7ceebe44d752.jpg not downloaded yet
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_7ebb47a4716eca49e313eda3ce1f9606.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_7ebb47a4716eca49e313eda3ce1f9606.jpg not downloaded yet
2026-03-20 10:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_c608c38e05eb350d4ac0a6440a3619d9.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_e43766cb3535dce1d7d4e729a9f229d3.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_daf58056e8874e232177de708ce2e677.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_e840e49dc37b8e163297c7df8aae8970.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_e840e49dc37b8e163297c7df8aae8970.jpg not downloaded yet
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81cc4cd0>
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_9b30a79a15e1e743ab1825c604866f51.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_9b30a79a15e1e743ab1825c604866f51.jpg saved to cache
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f9ebd0>
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_649a4b081f043ead42f08cb5d8e65925.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_649a4b081f043ead42f08cb5d8e65925.jpg saved to cache
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf819b6810>
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_8c0681f356c1071823a49c604ad5d5d1.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_8c0681f356c1071823a49c604ad5d5d1.jpg saved to cache
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b326251c-0e14-5130-83f0-07cea4f09500
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf810576d0>
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_0932d0f73ec651cb3d36c19d98606431.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_0932d0f73ec651cb3d36c19d98606431.jpg saved to cache
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d3f2d41-d20e-507d-befc-535074bab2b3
2026-03-20 10:20:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a23414e8-f097-574f-bc81-14461f4a9004 with identifier: TS83141
2026-03-20 10:20:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a23414e8-f097-574f-bc81-14461f4a9004 with scrape type 1
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a23414e8-f097-574f-bc81-14461f4a9004
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F72%252F4672caf37d7646d5f227dc2827253ba2%252Fpa%252FTS83141_f982067b878f3a72718085d0a970425b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_f982067b878f3a72718085d0a970425b.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F72%252F4672caf37d7646d5f227dc2827253ba2%252Fpa%252FTS83141_7314838a135f5bf2f3f2fb2838b1b3ac.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_7314838a135f5bf2f3f2fb2838b1b3ac.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F72%252F4672caf37d7646d5f227dc2827253ba2%252Fpa%252FTS83141_e8e1b3b8319f7fb6e83fac8fb347f4bd.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_e8e1b3b8319f7fb6e83fac8fb347f4bd.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F72%252F4672caf37d7646d5f227dc2827253ba2%252Fpa%252FTS83141_2dcce496baa98870024ca5e760d6e1b3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_2dcce496baa98870024ca5e760d6e1b3.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F72%252F4672caf37d7646d5f227dc2827253ba2%252Fpa%252FTS83141_ad8232c8dd71be6e2425cacd63209e03.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_ad8232c8dd71be6e2425cacd63209e03.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F72%252F4672caf37d7646d5f227dc2827253ba2%252Fpa%252FTS83141_7a8aa0502fd66bd69812d013b9ed6de1.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_7a8aa0502fd66bd69812d013b9ed6de1.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F72%252F4672caf37d7646d5f227dc2827253ba2%252Fpa%252FTS83141_c895b4003da8ca90cd0f674ca917843f.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_c895b4003da8ca90cd0f674ca917843f.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F72%252F4672caf37d7646d5f227dc2827253ba2%252Fpa%252FTS83141_11cbf04a768643550e88c4d0e2a8827b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_11cbf04a768643550e88c4d0e2a8827b.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F72%252F4672caf37d7646d5f227dc2827253ba2%252Fpa%252FTS83141_79efa7caab2b1e12ff7f19cd14069bc9.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_79efa7caab2b1e12ff7f19cd14069bc9.jpg already downloaded
2026-03-20 10:20:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a23414e8-f097-574f-bc81-14461f4a9004, identifier: TS83141
2026-03-20 10:20:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dce92a5-10b9-5958-a01c-a8078bc4cb14 with identifier: NV81298
2026-03-20 10:20:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dce92a5-10b9-5958-a01c-a8078bc4cb14 with scrape type 1
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2dce92a5-10b9-5958-a01c-a8078bc4cb14
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fea%252F63ea0e8f8a8eeed13a99ec57d605a602%252Fpa%252FNV81298_a51546db9d5a189d097c06e3171d7194.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_a51546db9d5a189d097c06e3171d7194.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fea%252F63ea0e8f8a8eeed13a99ec57d605a602%252Fpa%252FNV81298_ed771fda48bbcb6b1ea5242d0ec0ef92.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_ed771fda48bbcb6b1ea5242d0ec0ef92.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fea%252F63ea0e8f8a8eeed13a99ec57d605a602%252Fpa%252FNV81298_2cc7ea0a51628d1ea96dbd274494ec9e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_2cc7ea0a51628d1ea96dbd274494ec9e.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fea%252F63ea0e8f8a8eeed13a99ec57d605a602%252Fpa%252FNV81298_87fbbd82a7d72eb1c737113ee9137ad9.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_87fbbd82a7d72eb1c737113ee9137ad9.jpg already downloaded
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fea%252F63ea0e8f8a8eeed13a99ec57d605a602%252Fpa%252FNV81298_199470945b2cad330a81fd1baaf54912.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_199470945b2cad330a81fd1baaf54912.jpg already downloaded
2026-03-20 10:20:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2dce92a5-10b9-5958-a01c-a8078bc4cb14, identifier: NV81298
2026-03-20 10:20:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a23414e8-f097-574f-bc81-14461f4a9004 with identifier: TS83141
2026-03-20 10:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a23414e8-f097-574f-bc81-14461f4a9004 with identifier: TS83141
2026-03-20 10:20:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a23414e8-f097-574f-bc81-14461f4a9004 with identifier: TS83141 to the API
2026-03-20 10:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS83141>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-21T16:01:58Z',
 'fuel_type': 'electro',
 'id': 'a23414e8-f097-574f-bc81-14461f4a9004',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS83141',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 35168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 9,
 'photo_urls': ['https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_f982067b878f3a72718085d0a970425b.jpg',
                'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_7314838a135f5bf2f3f2fb2838b1b3ac.jpg',
                'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_e8e1b3b8319f7fb6e83fac8fb347f4bd.jpg',
                'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_2dcce496baa98870024ca5e760d6e1b3.jpg',
                'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_ad8232c8dd71be6e2425cacd63209e03.jpg',
                'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_7a8aa0502fd66bd69812d013b9ed6de1.jpg',
                'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_c895b4003da8ca90cd0f674ca917843f.jpg',
                'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_11cbf04a768643550e88c4d0e2a8827b.jpg',
                'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_79efa7caab2b1e12ff7f19cd14069bc9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23414e8-f097-574f-bc81-14461f4a9004/a23414e8-f097-574f-bc81-14461f4a9004_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290801,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_f982067b878f3a72718085d0a970425b.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23414e8-f097-574f-bc81-14461f4a9004/a23414e8-f097-574f-bc81-14461f4a9004_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301113,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_7314838a135f5bf2f3f2fb2838b1b3ac.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23414e8-f097-574f-bc81-14461f4a9004/a23414e8-f097-574f-bc81-14461f4a9004_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287687,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_e8e1b3b8319f7fb6e83fac8fb347f4bd.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23414e8-f097-574f-bc81-14461f4a9004/a23414e8-f097-574f-bc81-14461f4a9004_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303625,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_2dcce496baa98870024ca5e760d6e1b3.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23414e8-f097-574f-bc81-14461f4a9004/a23414e8-f097-574f-bc81-14461f4a9004_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337185,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_ad8232c8dd71be6e2425cacd63209e03.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23414e8-f097-574f-bc81-14461f4a9004/a23414e8-f097-574f-bc81-14461f4a9004_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387907,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_7a8aa0502fd66bd69812d013b9ed6de1.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23414e8-f097-574f-bc81-14461f4a9004/a23414e8-f097-574f-bc81-14461f4a9004_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436398,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_c895b4003da8ca90cd0f674ca917843f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23414e8-f097-574f-bc81-14461f4a9004/a23414e8-f097-574f-bc81-14461f4a9004_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265629,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_11cbf04a768643550e88c4d0e2a8827b.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23414e8-f097-574f-bc81-14461f4a9004/a23414e8-f097-574f-bc81-14461f4a9004_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63064,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img46/72/4672caf37d7646d5f227dc2827253ba2/pa/TS83141_79efa7caab2b1e12ff7f19cd14069bc9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 electric drive 100 kW Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2023}
2026-03-20 10:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS83141%27 HTTP/1.1" 200 None
2026-03-20 10:20:31 [auto1.nl] INFO: Saving data for TS83141: {'created_time': 1774002031.79434, 'last_price_update_time': 1774002031.794355, 'auction_closing_time': 1774108918.0}
2026-03-20 10:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TS83141') HTTP/1.1" 204 0
2026-03-20 10:20:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2dce92a5-10b9-5958-a01c-a8078bc4cb14 with identifier: NV81298
2026-03-20 10:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2dce92a5-10b9-5958-a01c-a8078bc4cb14 with identifier: NV81298
2026-03-20 10:20:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2dce92a5-10b9-5958-a01c-a8078bc4cb14 with identifier: NV81298 to the API
2026-03-20 10:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NV81298>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-21T16:24:47Z',
 'fuel_type': 'petrol',
 'id': '2dce92a5-10b9-5958-a01c-a8078bc4cb14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '29NRJ4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV81298',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 228096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_a51546db9d5a189d097c06e3171d7194.jpg',
                'https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_ed771fda48bbcb6b1ea5242d0ec0ef92.jpg',
                'https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_2cc7ea0a51628d1ea96dbd274494ec9e.jpg',
                'https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_87fbbd82a7d72eb1c737113ee9137ad9.jpg',
                'https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_199470945b2cad330a81fd1baaf54912.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dce92a5-10b9-5958-a01c-a8078bc4cb14/2dce92a5-10b9-5958-a01c-a8078bc4cb14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_a51546db9d5a189d097c06e3171d7194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dce92a5-10b9-5958-a01c-a8078bc4cb14/2dce92a5-10b9-5958-a01c-a8078bc4cb14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_ed771fda48bbcb6b1ea5242d0ec0ef92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dce92a5-10b9-5958-a01c-a8078bc4cb14/2dce92a5-10b9-5958-a01c-a8078bc4cb14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_2cc7ea0a51628d1ea96dbd274494ec9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dce92a5-10b9-5958-a01c-a8078bc4cb14/2dce92a5-10b9-5958-a01c-a8078bc4cb14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_87fbbd82a7d72eb1c737113ee9137ad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dce92a5-10b9-5958-a01c-a8078bc4cb14/2dce92a5-10b9-5958-a01c-a8078bc4cb14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/ea/63ea0e8f8a8eeed13a99ec57d605a602/pa/NV81298_199470945b2cad330a81fd1baaf54912.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV81298%27 HTTP/1.1" 200 None
2026-03-20 10:20:32 [auto1.nl] INFO: Saving data for NV81298: {'created_time': 1774002032.170975, 'last_price_update_time': 1774002032.170987, 'auction_closing_time': 1774110287.0}
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NV81298') HTTP/1.1" 204 0
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_c14b71136bf98222e88b52f30273b4a1.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_62bbdacc5b0a847a92ce17afe22a8f7e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_62bbdacc5b0a847a92ce17afe22a8f7e.jpg not downloaded yet
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_0b478de7fc1670ecbc0ee99106edd260.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_757170cde135deb92d8b0806b29c8d15.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_f1ab2f480c9a454912a75c737e401787.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_5d79d3c3a56f686ba907584a154a928e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d7a4d0>
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_532c5fd560df5f39d998bf4b78cf5f8f.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_532c5fd560df5f39d998bf4b78cf5f8f.jpg saved to cache
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e59bd0>
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_c608c38e05eb350d4ac0a6440a3619d9.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_c608c38e05eb350d4ac0a6440a3619d9.jpg saved to cache
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81077350>
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_e43766cb3535dce1d7d4e729a9f229d3.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_e43766cb3535dce1d7d4e729a9f229d3.jpg saved to cache
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b326251c-0e14-5130-83f0-07cea4f09500
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e5ad10>
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_daf58056e8874e232177de708ce2e677.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_daf58056e8874e232177de708ce2e677.jpg saved to cache
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d3f2d41-d20e-507d-befc-535074bab2b3
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_2a9f8b8aa7e29456a32d86596177641a.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80fa6e90>
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_c14b71136bf98222e88b52f30273b4a1.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_c14b71136bf98222e88b52f30273b4a1.jpg saved to cache
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b326251c-0e14-5130-83f0-07cea4f09500
2026-03-20 10:20:32 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 1055 | hits on page: 40
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e682d0>
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_0b478de7fc1670ecbc0ee99106edd260.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_0b478de7fc1670ecbc0ee99106edd260.jpg saved to cache
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d7e190>
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_757170cde135deb92d8b0806b29c8d15.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_757170cde135deb92d8b0806b29c8d15.jpg saved to cache
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81a7f450>
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_f1ab2f480c9a454912a75c737e401787.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_f1ab2f480c9a454912a75c737e401787.jpg saved to cache
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d683d0>
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_5d79d3c3a56f686ba907584a154a928e.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_5d79d3c3a56f686ba907584a154a928e.jpg saved to cache
2026-03-20 10:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d3f2d41-d20e-507d-befc-535074bab2b3
2026-03-20 10:20:32 [scrapy.extensions.logstats] INFO: Crawled 93 pages (at 44 pages/min), scraped 87 items (at 60 items/min)
2026-03-20 10:20:32 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_7a25141bd0c7533c24fd7ceebe44d752.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_83dd572065153f1654d0fe08791301d8.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_7ebb47a4716eca49e313eda3ce1f9606.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:32 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-20 10:20:32 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-20 10:20:32 [auto1.nl] INFO: Found listing with ID: ZJ53685
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ53685%27 HTTP/1.1" 200 None
2026-03-20 10:20:32 [auto1.nl] INFO: Scrape type for ZJ53685: 0
2026-03-20 10:20:32 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-20 10:20:32 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-20 10:20:32 [auto1.nl] INFO: Found listing with ID: FM09564
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM09564%27 HTTP/1.1" 200 None
2026-03-20 10:20:32 [auto1.nl] INFO: Scrape type for FM09564: 0
2026-03-20 10:20:32 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN17461%27 HTTP/1.1" 200 None
2026-03-20 10:20:32 [auto1.nl] INFO: Scrape type for JN17461: 0
2026-03-20 10:20:32 [auto1.nl] INFO: Found listing with ID: HR72702
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR72702%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for HR72702: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for CK37627: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC71604%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for UC71604: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: SH83411
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SH83411%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for SH83411: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: NC99143
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC99143%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for NC99143: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: YG36624
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG36624%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for YG36624: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: MD09508
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD09508%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for MD09508: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: KR93278
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR93278%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for KR93278: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US61568%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for US61568: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: MA73158
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MA73158%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for MA73158: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for RT17278: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LB35433%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for LB35433: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: VK43397
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK43397%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for VK43397: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: BM39529
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM39529%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for BM39529: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: ZR81683
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR81683%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for ZR81683: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for EY58020: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for KD36085: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: LP26890
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LP26890%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for LP26890: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV55742%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for PV55742: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD46513%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for GD46513: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: SY38458
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY38458%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for SY38458: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: VA86988
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA86988%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for VA86988: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: SG20975
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG20975%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for SG20975: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD16016%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for FD16016: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for ME98271: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for KB59261: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY73779%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for AY73779: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: LG92344
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG92344%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for LG92344: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: DH83344
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH83344%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for DH83344: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS28591%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for SS28591: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for LU83430: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: EZ06256
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EZ06256%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for EZ06256: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG27565%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for AG27565: 0
2026-03-20 10:20:33 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX29422%27 HTTP/1.1" 200 None
2026-03-20 10:20:33 [auto1.nl] INFO: Scrape type for AX29422: 0
2026-03-20 10:20:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b07a10>
2026-03-20 10:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_2a9f8b8aa7e29456a32d86596177641a.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_2a9f8b8aa7e29456a32d86596177641a.jpg saved to cache
2026-03-20 10:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b326251c-0e14-5130-83f0-07cea4f09500
2026-03-20 10:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_81f93d40747de7f7356520c6d72c1de9.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_5ef8f8862afb6b3f8ade577fad87243b.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c88610>
2026-03-20 10:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_7a25141bd0c7533c24fd7ceebe44d752.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_7a25141bd0c7533c24fd7ceebe44d752.jpg saved to cache
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81074f50>
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_83dd572065153f1654d0fe08791301d8.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_83dd572065153f1654d0fe08791301d8.jpg saved to cache
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b326251c-0e14-5130-83f0-07cea4f09500
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b07ed0>
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_7ebb47a4716eca49e313eda3ce1f9606.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_7ebb47a4716eca49e313eda3ce1f9606.jpg saved to cache
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b326251c-0e14-5130-83f0-07cea4f09500
2026-03-20 10:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_08624fa79aef583e1687799d1b171956.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_3da1ee787dd0a065120c46e5ae72a050.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_e840e49dc37b8e163297c7df8aae8970.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_e8d0729417c883098b60876df00df333.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83a5c250>
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcf%252F46cf7ba1caad945c26e380e446f5a277%252Fpa%252FGD85766_81f93d40747de7f7356520c6d72c1de9.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_81f93d40747de7f7356520c6d72c1de9.jpg saved to cache
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b326251c-0e14-5130-83f0-07cea4f09500
2026-03-20 10:20:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b326251c-0e14-5130-83f0-07cea4f09500, skipping ID generation
2026-03-20 10:20:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b326251c-0e14-5130-83f0-07cea4f09500 with scrape type 1
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b326251c-0e14-5130-83f0-07cea4f09500 sending to next pipeline
2026-03-20 10:20:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b326251c-0e14-5130-83f0-07cea4f09500, identifier: GD85766
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81c5c5d0>
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_5ef8f8862afb6b3f8ade577fad87243b.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_5ef8f8862afb6b3f8ade577fad87243b.jpg saved to cache
2026-03-20 10:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c
2026-03-20 10:20:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b326251c-0e14-5130-83f0-07cea4f09500 with identifier: GD85766
2026-03-20 10:20:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b326251c-0e14-5130-83f0-07cea4f09500 with identifier: GD85766
2026-03-20 10:20:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b326251c-0e14-5130-83f0-07cea4f09500 with identifier: GD85766 to the API
2026-03-20 10:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_81f93d40747de7f7356520c6d72c1de9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 286,
 'expiration_date': '2026-03-21T16:30:30Z',
 'fuel_type': 'electro',
 'id': 'b326251c-0e14-5130-83f0-07cea4f09500',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD85766',
 'listing': 'auction',
 'location': 'NL',
 'make': 'BMW',
 'model': 'iX3',
 'odometer': 156268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41743,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_15ff9de470561696051b39ce1ccaa576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38127,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_8c0681f356c1071823a49c604ad5d5d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308880,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_c14b71136bf98222e88b52f30273b4a1.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38671,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_e43766cb3535dce1d7d4e729a9f229d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446517,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_2a9f8b8aa7e29456a32d86596177641a.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521702,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_81f93d40747de7f7356520c6d72c1de9.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59837,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_83dd572065153f1654d0fe08791301d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b326251c-0e14-5130-83f0-07cea4f09500/b326251c-0e14-5130-83f0-07cea4f09500_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48194,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cf/46cf7ba1caad945c26e380e446f5a277/pa/GD85766_7ebb47a4716eca49e313eda3ce1f9606.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW iX3 electric drive 210 kW Impressive',
 'transmission': 'automatic',
 'trim': 'Impressive',
 'year': 2021}
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD85766%27 HTTP/1.1" 200 None
2026-03-20 10:20:35 [auto1.nl] INFO: Saving data for GD85766: {'created_time': 1774002035.299269, 'last_price_update_time': 1774002035.299281, 'auction_closing_time': 1774110630.0}
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD85766') HTTP/1.1" 204 0
2026-03-20 10:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_51a1878121eff9a812accf1f870558f7.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_0ac903f0a27f2ae54f7671fdf1ea3ba2.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_0f9d0c544e97c65c31e8e118d9833673.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_35d6c6f9fe5ed6ea89b93db0e53fa029.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81bf0190>
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_08624fa79aef583e1687799d1b171956.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_08624fa79aef583e1687799d1b171956.jpg saved to cache
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f83190>
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_3da1ee787dd0a065120c46e5ae72a050.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_3da1ee787dd0a065120c46e5ae72a050.jpg saved to cache
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d4f8d0>
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_e840e49dc37b8e163297c7df8aae8970.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_e840e49dc37b8e163297c7df8aae8970.jpg saved to cache
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80ea0990>
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_e8d0729417c883098b60876df00df333.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_e8d0729417c883098b60876df00df333.jpg saved to cache
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf810903d0>
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_51a1878121eff9a812accf1f870558f7.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_51a1878121eff9a812accf1f870558f7.jpg saved to cache
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e6db90>
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F91%252Fee91f4af66bbccc98f1f6706883f4df8%252Fpa%252FRL17595_0ac903f0a27f2ae54f7671fdf1ea3ba2.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_0ac903f0a27f2ae54f7671fdf1ea3ba2.jpg saved to cache
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c
2026-03-20 10:20:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 440e12e1-6f57-5e12-b6ba-3d5ed62a513c, skipping ID generation
2026-03-20 10:20:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c with scrape type 1
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 440e12e1-6f57-5e12-b6ba-3d5ed62a513c sending to next pipeline
2026-03-20 10:20:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 440e12e1-6f57-5e12-b6ba-3d5ed62a513c, identifier: RL17595
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d83510>
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F46%252F2546542017dd414a7d46d27cf22f1da7%252Fpa%252FJS15823_0f9d0c544e97c65c31e8e118d9833673.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_0f9d0c544e97c65c31e8e118d9833673.jpg saved to cache
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b773671f-c0a8-5188-bb3d-37c8915d6b99
2026-03-20 10:20:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b773671f-c0a8-5188-bb3d-37c8915d6b99, skipping ID generation
2026-03-20 10:20:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b773671f-c0a8-5188-bb3d-37c8915d6b99 with scrape type 1
2026-03-20 10:20:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b773671f-c0a8-5188-bb3d-37c8915d6b99 sending to next pipeline
2026-03-20 10:20:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b773671f-c0a8-5188-bb3d-37c8915d6b99, identifier: JS15823
2026-03-20 10:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e483d0>
2026-03-20 10:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe4%252F4ee4b057ceceb878c9337b1cde1975ef%252Fpa%252FUJ12956_35d6c6f9fe5ed6ea89b93db0e53fa029.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_35d6c6f9fe5ed6ea89b93db0e53fa029.jpg saved to cache
2026-03-20 10:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d3f2d41-d20e-507d-befc-535074bab2b3
2026-03-20 10:20:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d3f2d41-d20e-507d-befc-535074bab2b3, skipping ID generation
2026-03-20 10:20:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d3f2d41-d20e-507d-befc-535074bab2b3 with scrape type 1
2026-03-20 10:20:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d3f2d41-d20e-507d-befc-535074bab2b3 sending to next pipeline
2026-03-20 10:20:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5d3f2d41-d20e-507d-befc-535074bab2b3, identifier: UJ12956
2026-03-20 10:20:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 440e12e1-6f57-5e12-b6ba-3d5ed62a513c with identifier: RL17595
2026-03-20 10:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 440e12e1-6f57-5e12-b6ba-3d5ed62a513c with identifier: RL17595
2026-03-20 10:20:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 440e12e1-6f57-5e12-b6ba-3d5ed62a513c with identifier: RL17595 to the API
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_0ac903f0a27f2ae54f7671fdf1ea3ba2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 795,
 'expiration_date': '2026-03-21T16:58:19Z',
 'fuel_type': 'electro',
 'id': '440e12e1-6f57-5e12-b6ba-3d5ed62a513c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL17595',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Tesla',
 'model': 'Model S',
 'odometer': 120907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39879,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_7a286025aaede201986a53649ac17d9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331021,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_0b478de7fc1670ecbc0ee99106edd260.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38129,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_0ac903f0a27f2ae54f7671fdf1ea3ba2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40361,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_757170cde135deb92d8b0806b29c8d15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42306,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_532c5fd560df5f39d998bf4b78cf5f8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401939,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_e8d0729417c883098b60876df00df333.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50254,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_5ef8f8862afb6b3f8ade577fad87243b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_440e12e1-6f57-5e12-b6ba-3d5ed62a513c/440e12e1-6f57-5e12-b6ba-3d5ed62a513c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299400,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/91/ee91f4af66bbccc98f1f6706883f4df8/pa/RL17595_08624fa79aef583e1687799d1b171956.jpg',
             'Width': 1920}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model S Performance',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL17595%27 HTTP/1.1" 200 None
2026-03-20 10:20:36 [auto1.nl] INFO: Saving data for RL17595: {'created_time': 1774002036.681292, 'last_price_update_time': 1774002036.681301, 'auction_closing_time': 1774112299.0}
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RL17595') HTTP/1.1" 204 0
2026-03-20 10:20:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b773671f-c0a8-5188-bb3d-37c8915d6b99 with identifier: JS15823
2026-03-20 10:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b773671f-c0a8-5188-bb3d-37c8915d6b99 with identifier: JS15823
2026-03-20 10:20:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b773671f-c0a8-5188-bb3d-37c8915d6b99 with identifier: JS15823 to the API
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_0f9d0c544e97c65c31e8e118d9833673.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 571,
 'expiration_date': '2026-03-21T16:34:33Z',
 'fuel_type': 'electro',
 'id': 'b773671f-c0a8-5188-bb3d-37c8915d6b99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS15823',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Porsche',
 'model': 'Taycan',
 'odometer': 74724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38515,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_407b7adf444b93f5b4babfd75b714aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313012,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_c2d9628a7522a10079f11b7f7f8af3df.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289615,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_76da03559ee5dd9291e2de96ffa0fb57.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314901,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_446318a792a40ee9a22bfb2d750dcc87.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528833,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_649a4b081f043ead42f08cb5d8e65925.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528282,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_9b30a79a15e1e743ab1825c604866f51.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53064,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_39b8ba409b33cfd04ace63874d19b68f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325997,
             'Height': 1280,
             'OriginUrl': 'https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_aa507295c5afa73714a62cff5e945296.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b773671f-c0a8-5188-bb3d-37c8915d6b99/b773671f-c0a8-5188-bb3d-37c8915d6b99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59674,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img25/46/2546542017dd414a7d46d27cf22f1da7/pa/JS15823_0f9d0c544e97c65c31e8e118d9833673.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Taycan 4S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS15823%27 HTTP/1.1" 200 None
2026-03-20 10:20:37 [auto1.nl] INFO: Saving data for JS15823: {'created_time': 1774002037.051651, 'last_price_update_time': 1774002037.051659, 'auction_closing_time': 1774110873.0}
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JS15823') HTTP/1.1" 204 0
2026-03-20 10:20:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5d3f2d41-d20e-507d-befc-535074bab2b3 with identifier: UJ12956
2026-03-20 10:20:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5d3f2d41-d20e-507d-befc-535074bab2b3 with identifier: UJ12956
2026-03-20 10:20:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5d3f2d41-d20e-507d-befc-535074bab2b3 with identifier: UJ12956 to the API
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_35d6c6f9fe5ed6ea89b93db0e53fa029.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 304,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.3L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-21T16:57:04Z',
 'fuel_type': 'petrol',
 'id': '5d3f2d41-d20e-507d-befc-535074bab2b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '18XTSP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ12956',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 241375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_fe5d9c27749557ef81acd054f0b422f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_0932d0f73ec651cb3d36c19d98606431.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_35d6c6f9fe5ed6ea89b93db0e53fa029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_5d79d3c3a56f686ba907584a154a928e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d3f2d41-d20e-507d-befc-535074bab2b3/5d3f2d41-d20e-507d-befc-535074bab2b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e4/4ee4b057ceceb878c9337b1cde1975ef/pa/UJ12956_daf58056e8874e232177de708ce2e677.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-10-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 3.3 V6 Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2007}
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ12956%27 HTTP/1.1" 200 None
2026-03-20 10:20:37 [auto1.nl] INFO: Saving data for UJ12956: {'created_time': 1774002037.44925, 'last_price_update_time': 1774002037.449261, 'auction_closing_time': 1774112224.0}
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UJ12956') HTTP/1.1" 204 0
2026-03-20 10:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_980f529a8eb32c9131f66dffb2bf83a4.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_d310946fc2a16c81d8680f1f39b187ee.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_62bbdacc5b0a847a92ce17afe22a8f7e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:20:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80f964d0>
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_980f529a8eb32c9131f66dffb2bf83a4.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_980f529a8eb32c9131f66dffb2bf83a4.jpg saved to cache
2026-03-20 10:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80c41010>
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_d310946fc2a16c81d8680f1f39b187ee.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_d310946fc2a16c81d8680f1f39b187ee.jpg saved to cache
2026-03-20 10:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80dbc310>
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Ff6%252Fbff69fe1201109cb7fa563e3f7bd7598%252Fpa%252FMT74092_62bbdacc5b0a847a92ce17afe22a8f7e.jpg') HTTP/1.1" 204 0
2026-03-20 10:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_62bbdacc5b0a847a92ce17afe22a8f7e.jpg saved to cache
2026-03-20 10:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7
2026-03-20 10:20:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1a46fcd-1407-5fb4-98a9-3c826dbccda7, skipping ID generation
2026-03-20 10:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7 with scrape type 1
2026-03-20 10:20:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1a46fcd-1407-5fb4-98a9-3c826dbccda7 sending to next pipeline
2026-03-20 10:20:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d1a46fcd-1407-5fb4-98a9-3c826dbccda7, identifier: MT74092
2026-03-20 10:20:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d1a46fcd-1407-5fb4-98a9-3c826dbccda7 with identifier: MT74092
2026-03-20 10:20:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d1a46fcd-1407-5fb4-98a9-3c826dbccda7 with identifier: MT74092
2026-03-20 10:20:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d1a46fcd-1407-5fb4-98a9-3c826dbccda7 with identifier: MT74092 to the API
2026-03-20 10:20:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:20:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_62bbdacc5b0a847a92ce17afe22a8f7e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-21T16:55:36Z',
 'fuel_type': 'petrol',
 'id': 'd1a46fcd-1407-5fb4-98a9-3c826dbccda7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GF542P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT74092',
 'listing': 'auction',
 'location': 'NL, Haarlem',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 162882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_347f876405f250beab6b6b4ebd1a753e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579129,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_980f529a8eb32c9131f66dffb2bf83a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_51a1878121eff9a812accf1f870558f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_f1ab2f480c9a454912a75c737e401787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_c608c38e05eb350d4ac0a6440a3619d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370394,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_d310946fc2a16c81d8680f1f39b187ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_3da1ee787dd0a065120c46e5ae72a050.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_7a25141bd0c7533c24fd7ceebe44d752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_e840e49dc37b8e163297c7df8aae8970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a46fcd-1407-5fb4-98a9-3c826dbccda7/d1a46fcd-1407-5fb4-98a9-3c826dbccda7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539502,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/f6/bff69fe1201109cb7fa563e3f7bd7598/pa/MT74092_62bbdacc5b0a847a92ce17afe22a8f7e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-20 10:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT74092%27 HTTP/1.1" 200 None
2026-03-20 10:20:38 [auto1.nl] INFO: Saving data for MT74092: {'created_time': 1774002038.582923, 'last_price_update_time': 1774002038.582937, 'auction_closing_time': 1774112136.0}
2026-03-20 10:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MT74092') HTTP/1.1" 204 0
2026-03-20 10:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ43078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:20:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:21:32 [scrapy.extensions.logstats] INFO: Crawled 93 pages (at 0 pages/min), scraped 92 items (at 5 items/min)
2026-03-20 10:21:32 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-20 10:21:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ43078> (referer: https://www.auto1.com/v1/car-details-view/VJ43078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:21:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b770400c-cfda-518d-97f8-1823d0616a18 with identifier: VJ43078
2026-03-20 10:21:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b770400c-cfda-518d-97f8-1823d0616a18 with scrape type 1
2026-03-20 10:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b770400c-cfda-518d-97f8-1823d0616a18
2026-03-20 10:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_d7c059e3a2c5e9effc0aad90d785c482.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_d7c059e3a2c5e9effc0aad90d785c482.jpg not downloaded yet
2026-03-20 10:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_51a2f1cacd07166a57b07333d7b0ab28.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_51a2f1cacd07166a57b07333d7b0ab28.jpg not downloaded yet
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_9b76edb6654a41a69ee01b0ee3860a41.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_9b76edb6654a41a69ee01b0ee3860a41.jpg not downloaded yet
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_1c5e38caaf20aee0d85ca0a67763d641.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_1c5e38caaf20aee0d85ca0a67763d641.jpg not downloaded yet
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_799ecd2ef4b2e356725d16643ff1ecfa.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_799ecd2ef4b2e356725d16643ff1ecfa.jpg not downloaded yet
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_df6254437c8eff05abbd9bc8b91814a6.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_df6254437c8eff05abbd9bc8b91814a6.jpg not downloaded yet
2026-03-20 10:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_d7c059e3a2c5e9effc0aad90d785c482.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_51a2f1cacd07166a57b07333d7b0ab28.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_9b76edb6654a41a69ee01b0ee3860a41.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83e29f10>
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_d7c059e3a2c5e9effc0aad90d785c482.jpg') HTTP/1.1" 204 0
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_d7c059e3a2c5e9effc0aad90d785c482.jpg saved to cache
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b770400c-cfda-518d-97f8-1823d0616a18
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d5c990>
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_51a2f1cacd07166a57b07333d7b0ab28.jpg') HTTP/1.1" 204 0
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_51a2f1cacd07166a57b07333d7b0ab28.jpg saved to cache
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b770400c-cfda-518d-97f8-1823d0616a18
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e0c910>
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_9b76edb6654a41a69ee01b0ee3860a41.jpg') HTTP/1.1" 204 0
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_9b76edb6654a41a69ee01b0ee3860a41.jpg saved to cache
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b770400c-cfda-518d-97f8-1823d0616a18
2026-03-20 10:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_1c5e38caaf20aee0d85ca0a67763d641.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_799ecd2ef4b2e356725d16643ff1ecfa.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_df6254437c8eff05abbd9bc8b91814a6.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8421d0d0>
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_1c5e38caaf20aee0d85ca0a67763d641.jpg') HTTP/1.1" 204 0
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_1c5e38caaf20aee0d85ca0a67763d641.jpg saved to cache
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b770400c-cfda-518d-97f8-1823d0616a18
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80d76610>
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_799ecd2ef4b2e356725d16643ff1ecfa.jpg') HTTP/1.1" 204 0
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_799ecd2ef4b2e356725d16643ff1ecfa.jpg saved to cache
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b770400c-cfda-518d-97f8-1823d0616a18
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf83d41d50>
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F35%252Fe93564cc22d468ae591e8cf52d308e2c%252Fpa%252FVJ43078_df6254437c8eff05abbd9bc8b91814a6.jpg') HTTP/1.1" 204 0
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_df6254437c8eff05abbd9bc8b91814a6.jpg saved to cache
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b770400c-cfda-518d-97f8-1823d0616a18
2026-03-20 10:21:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b770400c-cfda-518d-97f8-1823d0616a18, skipping ID generation
2026-03-20 10:21:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b770400c-cfda-518d-97f8-1823d0616a18 with scrape type 1
2026-03-20 10:21:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b770400c-cfda-518d-97f8-1823d0616a18 sending to next pipeline
2026-03-20 10:21:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b770400c-cfda-518d-97f8-1823d0616a18, identifier: VJ43078
2026-03-20 10:21:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b770400c-cfda-518d-97f8-1823d0616a18 with identifier: VJ43078
2026-03-20 10:21:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b770400c-cfda-518d-97f8-1823d0616a18 with identifier: VJ43078
2026-03-20 10:21:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b770400c-cfda-518d-97f8-1823d0616a18 with identifier: VJ43078 to the API
2026-03-20 10:21:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:21:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_df6254437c8eff05abbd9bc8b91814a6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 585,
 'expiration_date': '2026-03-21T16:11:03Z',
 'fuel_type': 'electro',
 'id': 'b770400c-cfda-518d-97f8-1823d0616a18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ43078',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 103394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41600,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_d7c059e3a2c5e9effc0aad90d785c482.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41440,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_51a2f1cacd07166a57b07333d7b0ab28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45061,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_9b76edb6654a41a69ee01b0ee3860a41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62609,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_1c5e38caaf20aee0d85ca0a67763d641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56102,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_799ecd2ef4b2e356725d16643ff1ecfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b770400c-cfda-518d-97f8-1823d0616a18/b770400c-cfda-518d-97f8-1823d0616a18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40988,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/35/e93564cc22d468ae591e8cf52d308e2c/pa/VJ43078_df6254437c8eff05abbd9bc8b91814a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia EV6 electric drive 430 kW GT 4WD',
 'transmission': 'automatic',
 'trim': 'GT 4WD',
 'year': 2023}
2026-03-20 10:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ43078%27 HTTP/1.1" 200 None
2026-03-20 10:21:59 [auto1.nl] INFO: Saving data for VJ43078: {'created_time': 1774002119.192403, 'last_price_update_time': 1774002119.192413, 'auction_closing_time': 1774109463.0}
2026-03-20 10:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VJ43078') HTTP/1.1" 204 0
2026-03-20 10:22:32 [scrapy.extensions.logstats] INFO: Crawled 94 pages (at 1 pages/min), scraped 93 items (at 1 items/min)
2026-03-20 10:22:32 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-20 10:22:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.536(s), this was the 1st time calling it.
2026-03-20 10:22:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.558492191729616 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-20 10:22:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.917(s), this was the 1st time calling it.
2026-03-20 10:22:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.422142869784644 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-20 10:22:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-20 10:22:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:22:50 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 1055 | hits on page: 40
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for ZX00670: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX60140%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for DX60140: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: RM70406
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM70406%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for RM70406: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ79748%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for KZ79748: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: DW60052
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW60052%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for DW60052: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: YR36694
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR36694%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for YR36694: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ53353%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for GJ53353: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for SM80467: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: XD86855
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD86855%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for XD86855: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: VL53472
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL53472%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for VL53472: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: TU17457
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU17457%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for TU17457: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for RY27630: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for LE78061: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF26708%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for RF26708: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for CL54405: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: MJ94209
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ94209%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for MJ94209: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for TU99712: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: VC25009
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC25009%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for VC25009: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK53801%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for MK53801: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for FW39949: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN23343%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for DN23343: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN91004%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for ZN91004: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR57884%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for HR57884: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-20 10:22:50 [auto1.nl] INFO: Scrape type for RH72913: 0
2026-03-20 10:22:50 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE07058%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for PE07058: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS32339%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for VS32339: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF97973%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for PF97973: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: VE84801
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE84801%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for VE84801: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: UC03677
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC03677%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for UC03677: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: VN60794
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN60794%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for VN60794: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: MC77607
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC77607%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for MC77607: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for EG83115: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: VJ48775
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ48775%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for VJ48775: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for GN29290: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP19214%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for WP19214: 0
2026-03-20 10:22:51 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-20 10:22:51 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-20 10:22:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:22:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-20 10:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV51543> (referer: https://www.auto1.com/v1/car-details-view/UV51543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:22:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6de1bd27-bd00-57ea-8e40-264c08ec4759 with identifier: UV51543
2026-03-20 10:22:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6de1bd27-bd00-57ea-8e40-264c08ec4759 with scrape type 1
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_1afa38384396ceca5c625312820ff8c3.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_1afa38384396ceca5c625312820ff8c3.jpg not downloaded yet
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_402bc6bd1b8d69519c7e42e346a2a072.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_402bc6bd1b8d69519c7e42e346a2a072.jpg not downloaded yet
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_f5a372a556efc3a39ca4199c0b073dcb.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_f5a372a556efc3a39ca4199c0b073dcb.jpg not downloaded yet
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_6431152a77f58a3b6e32b09d83bbeb6e.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_6431152a77f58a3b6e32b09d83bbeb6e.jpg not downloaded yet
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_47834113b254ccff58ecb2c84712f2ab.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_47834113b254ccff58ecb2c84712f2ab.jpg not downloaded yet
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_827a5c0c3000433cdccb6136d7b70317.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_827a5c0c3000433cdccb6136d7b70317.jpg not downloaded yet
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_f0501a3601d9855b872769ba9a759f6d.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_f0501a3601d9855b872769ba9a759f6d.jpg not downloaded yet
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_aadee30bb054fb5a9b8d719ab7d5ea6b.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_aadee30bb054fb5a9b8d719ab7d5ea6b.jpg not downloaded yet
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_a250f8e3f3905da5395779d0416d98f9.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_a250f8e3f3905da5395779d0416d98f9.jpg not downloaded yet
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_97dd3b2b388699cce93107af6a2ee809.jpg%27 HTTP/1.1" 200 None
2026-03-20 10:22:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_97dd3b2b388699cce93107af6a2ee809.jpg not downloaded yet
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_1afa38384396ceca5c625312820ff8c3.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_6431152a77f58a3b6e32b09d83bbeb6e.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_827a5c0c3000433cdccb6136d7b70317.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_47834113b254ccff58ecb2c84712f2ab.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_97dd3b2b388699cce93107af6a2ee809.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e5a8d0>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_0.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_1afa38384396ceca5c625312820ff8c3.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_1afa38384396ceca5c625312820ff8c3.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf810b47d0>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_3.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_6431152a77f58a3b6e32b09d83bbeb6e.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_6431152a77f58a3b6e32b09d83bbeb6e.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81b11a50>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_5.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_827a5c0c3000433cdccb6136d7b70317.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_827a5c0c3000433cdccb6136d7b70317.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf81cd6210>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_4.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_47834113b254ccff58ecb2c84712f2ab.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_47834113b254ccff58ecb2c84712f2ab.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e6b010>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_9.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_97dd3b2b388699cce93107af6a2ee809.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_97dd3b2b388699cce93107af6a2ee809.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_402bc6bd1b8d69519c7e42e346a2a072.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_f5a372a556efc3a39ca4199c0b073dcb.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_a250f8e3f3905da5395779d0416d98f9.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_f0501a3601d9855b872769ba9a759f6d.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_aadee30bb054fb5a9b8d719ab7d5ea6b.jpg> (referer: https://www.auto1.com/)
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e71d50>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_1.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_402bc6bd1b8d69519c7e42e346a2a072.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_402bc6bd1b8d69519c7e42e346a2a072.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80e71710>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_2.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_f5a372a556efc3a39ca4199c0b073dcb.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_f5a372a556efc3a39ca4199c0b073dcb.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf8194f3d0>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_8.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_a250f8e3f3905da5395779d0416d98f9.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_a250f8e3f3905da5395779d0416d98f9.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf82962a50>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_6.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_f0501a3601d9855b872769ba9a759f6d.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_f0501a3601d9855b872769ba9a759f6d.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7faf80dcdf50>
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-20 10:22:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_7.jpg HTTP/1.1" 201 0
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fbe%252F9ebe180b78a92d1e671a588afe4ae609%252Fpa%252FUV51543_aadee30bb054fb5a9b8d719ab7d5ea6b.jpg') HTTP/1.1" 204 0
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_aadee30bb054fb5a9b8d719ab7d5ea6b.jpg saved to cache
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6de1bd27-bd00-57ea-8e40-264c08ec4759
2026-03-20 10:22:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6de1bd27-bd00-57ea-8e40-264c08ec4759, skipping ID generation
2026-03-20 10:22:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6de1bd27-bd00-57ea-8e40-264c08ec4759 with scrape type 1
2026-03-20 10:22:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6de1bd27-bd00-57ea-8e40-264c08ec4759 sending to next pipeline
2026-03-20 10:22:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6de1bd27-bd00-57ea-8e40-264c08ec4759, identifier: UV51543
2026-03-20 10:22:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6de1bd27-bd00-57ea-8e40-264c08ec4759 with identifier: UV51543
2026-03-20 10:22:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6de1bd27-bd00-57ea-8e40-264c08ec4759 with identifier: UV51543
2026-03-20 10:22:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6de1bd27-bd00-57ea-8e40-264c08ec4759 with identifier: UV51543 to the API
2026-03-20 10:22:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-20 10:22:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-20 10:22:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_aadee30bb054fb5a9b8d719ab7d5ea6b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 279,
 'expiration_date': '2026-03-21T16:01:42Z',
 'fuel_type': 'hybrid',
 'id': '6de1bd27-bd00-57ea-8e40-264c08ec4759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV51543',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 184413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_1afa38384396ceca5c625312820ff8c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_402bc6bd1b8d69519c7e42e346a2a072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_f5a372a556efc3a39ca4199c0b073dcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_6431152a77f58a3b6e32b09d83bbeb6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_47834113b254ccff58ecb2c84712f2ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_827a5c0c3000433cdccb6136d7b70317.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_f0501a3601d9855b872769ba9a759f6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_aadee30bb054fb5a9b8d719ab7d5ea6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_a250f8e3f3905da5395779d0416d98f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6de1bd27-bd00-57ea-8e40-264c08ec4759/6de1bd27-bd00-57ea-8e40-264c08ec4759_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/be/9ebe180b78a92d1e671a588afe4ae609/pa/UV51543_97dd3b2b388699cce93107af6a2ee809.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2016}
2026-03-20 10:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV51543%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Saving data for UV51543: {'created_time': 1774002176.006673, 'last_price_update_time': 1774002176.006685, 'auction_closing_time': 1774108902.0}
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UV51543') HTTP/1.1" 204 0
2026-03-20 10:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:22:56 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 1055 | hits on page: 40
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for YW05960: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: VL69131
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL69131%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for VL69131: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for GL61326: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for ZP12059: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZV50646%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for ZV50646: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: FZ55104
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ55104%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for FZ55104: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: GU46876
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU46876%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for GU46876: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for RJ64387: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for VU12203: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for SE84312: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for JG11787: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for AC84495: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: UD65728
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD65728%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for UD65728: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV45583%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for VV45583: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY98170%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for NY98170: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: DF85024
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF85024%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for DF85024: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: HT74719
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT74719%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for HT74719: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: PY46861
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY46861%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for PY46861: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC11957%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for UC11957: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for KP34214: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN49901%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for PN49901: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for GB93242: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: EJ17993
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ17993%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for EJ17993: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: AJ59611
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ59611%27 HTTP/1.1" 200 None
2026-03-20 10:22:56 [auto1.nl] INFO: Scrape type for AJ59611: 0
2026-03-20 10:22:56 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-20 10:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for SV78620: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: WN67246
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN67246%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for WN67246: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER73656%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for ER73656: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: MA73251
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MA73251%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for MA73251: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: ZG84517
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG84517%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for ZG84517: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM68781%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for AM68781: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN62257%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for JN62257: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for CD19489: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: GY49056
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY49056%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for GY49056: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: AY95318
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY95318%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for AY95318: 0
2026-03-20 10:22:57 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ05855%27 HTTP/1.1" 200 None
2026-03-20 10:22:57 [auto1.nl] INFO: Scrape type for BZ05855: 0
2026-03-20 10:22:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:13 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: MC01443
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC01443%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for MC01443: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: BS02339
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BS02339%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for BS02339: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for BX66014: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: YH86907
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH86907%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for YH86907: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV26065%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for TV26065: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for KW64079: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for WN75862: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: PR43628
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PR43628%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for PR43628: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS78971%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for AS78971: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: HW54895
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW54895%27 HTTP/1.1" 200 None
2026-03-20 10:23:13 [auto1.nl] INFO: Scrape type for HW54895: 0
2026-03-20 10:23:13 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH10928%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for PH10928: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for NX76865: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for ZU81802: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: NV57291
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV57291%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for NV57291: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for TC15988: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: FS94964
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS94964%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for FS94964: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV65488%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for AV65488: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT56594%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for NT56594: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: WB35267
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WB35267%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for WB35267: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT03654%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for ZT03654: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: VY58880
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY58880%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for VY58880: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: BU43526
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU43526%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for BU43526: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK48888%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for CK48888: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for EP75091: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: AN32414
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN32414%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for AN32414: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT08140%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for UT08140: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for AZ90827: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: KY62085
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KY62085%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for KY62085: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for VD56637: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV76653%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for CV76653: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA77037%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for CA77037: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: ZH79500
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZH79500%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for ZH79500: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: NJ28414
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ28414%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for NJ28414: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: BF56002
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF56002%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for BF56002: 0
2026-03-20 10:23:14 [auto1.nl] INFO: Found listing with ID: XD17575
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD17575%27 HTTP/1.1" 200 None
2026-03-20 10:23:14 [auto1.nl] INFO: Scrape type for XD17575: 0
2026-03-20 10:23:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:18 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:18 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ29701%27 HTTP/1.1" 200 None
2026-03-20 10:23:18 [auto1.nl] INFO: Scrape type for XZ29701: 0
2026-03-20 10:23:18 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC82380%27 HTTP/1.1" 200 None
2026-03-20 10:23:18 [auto1.nl] INFO: Scrape type for RC82380: 0
2026-03-20 10:23:18 [auto1.nl] INFO: Found listing with ID: EU31453
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU31453%27 HTTP/1.1" 200 None
2026-03-20 10:23:18 [auto1.nl] INFO: Scrape type for EU31453: 0
2026-03-20 10:23:18 [auto1.nl] INFO: Found listing with ID: SL84811
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL84811%27 HTTP/1.1" 200 None
2026-03-20 10:23:18 [auto1.nl] INFO: Scrape type for SL84811: 0
2026-03-20 10:23:18 [auto1.nl] INFO: Found listing with ID: ZJ89710
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ89710%27 HTTP/1.1" 200 None
2026-03-20 10:23:18 [auto1.nl] INFO: Scrape type for ZJ89710: 0
2026-03-20 10:23:18 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD71761%27 HTTP/1.1" 200 None
2026-03-20 10:23:18 [auto1.nl] INFO: Scrape type for BD71761: 0
2026-03-20 10:23:18 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ61661%27 HTTP/1.1" 200 None
2026-03-20 10:23:18 [auto1.nl] INFO: Scrape type for JJ61661: 0
2026-03-20 10:23:18 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-20 10:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL54745%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for NL54745: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN29511%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for LN29511: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for AA80905: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: KM69825
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM69825%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for KM69825: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: JA24129
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA24129%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for JA24129: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ37745%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for DZ37745: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for VX32369: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for JN77730: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT81070%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for VT81070: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX68417%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for BX68417: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: TV56394
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV56394%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for TV56394: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: WR49821
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR49821%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for WR49821: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU47491%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for FU47491: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: KF52500
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF52500%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for KF52500: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH26666%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for FH26666: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: DV81797
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV81797%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for DV81797: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: BT36083
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BT36083%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for BT36083: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: PY99234
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY99234%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for PY99234: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: ZL35472
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL35472%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for ZL35472: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: FM74827
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM74827%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for FM74827: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for GP63449: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for AV73218: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for EH64896: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for AR18023: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: ZG24063
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG24063%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for ZG24063: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: DE00152
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE00152%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for DE00152: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for ZP69271: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for AR80776: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA05511%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for GA05511: 0
2026-03-20 10:23:19 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UM83404%27 HTTP/1.1" 200 None
2026-03-20 10:23:19 [auto1.nl] INFO: Scrape type for UM83404: 0
2026-03-20 10:23:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:21 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB77408%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for DB77408: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA24721%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for JA24721: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: BZ97098
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ97098%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for BZ97098: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: GY66945
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY66945%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for GY66945: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX58095%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for NX58095: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: CW50836
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW50836%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for CW50836: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for BN23461: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for WF02577: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: FB91665
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB91665%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for FB91665: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-20 10:23:21 [auto1.nl] INFO: Scrape type for SR40415: 0
2026-03-20 10:23:21 [auto1.nl] INFO: Found listing with ID: JL48416
2026-03-20 10:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL48416%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for JL48416: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for HK88309: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: JD50530
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD50530%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for JD50530: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: VA28711
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA28711%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for VA28711: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: LT99069
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT99069%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for LT99069: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB97698%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for KB97698: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: ND24425
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND24425%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for ND24425: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF13201%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for KF13201: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: JY83333
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY83333%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for JY83333: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: US93056
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US93056%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for US93056: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: JC15430
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC15430%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for JC15430: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: BB44396
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB44396%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for BB44396: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: SE65923
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE65923%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for SE65923: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: KT94650
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT94650%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for KT94650: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: NM36434
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM36434%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for NM36434: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM51490%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for AM51490: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: ZS06916
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS06916%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for ZS06916: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH92548%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for NH92548: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for WM06162: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: CB67795
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CB67795%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for CB67795: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: KM56172
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM56172%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for KM56172: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for LF75031: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for PT29526: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: BD89873
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD89873%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for BD89873: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA42645%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for FA42645: 0
2026-03-20 10:23:22 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC83701%27 HTTP/1.1" 200 None
2026-03-20 10:23:22 [auto1.nl] INFO: Scrape type for UC83701: 0
2026-03-20 10:23:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:24 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for DU88284: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF65643%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for XF65643: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: YM94322
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM94322%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for YM94322: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU28768%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for PU28768: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: RM91538
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM91538%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for RM91538: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for HW48392: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK53895%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for FK53895: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for MZ50492: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for SY10793: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: HL09506
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL09506%27 HTTP/1.1" 200 None
2026-03-20 10:23:24 [auto1.nl] INFO: Scrape type for HL09506: 0
2026-03-20 10:23:24 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-20 10:23:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: BE95458
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE95458%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for BE95458: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for LR40141: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: DN50098
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN50098%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for DN50098: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: UV46581
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV46581%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for UV46581: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: JP53443
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP53443%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for JP53443: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: XF96679
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF96679%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for XF96679: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for MR73967: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: WW58330
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW58330%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for WW58330: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for TB82163: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: VJ68289
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ68289%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for VJ68289: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: MK38575
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK38575%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for MK38575: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU55364%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for MU55364: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: NN53717
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN53717%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for NN53717: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: SG23258
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG23258%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for SG23258: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: FN38553
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FN38553%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for FN38553: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE49757%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for YE49757: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: WV56840
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV56840%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for WV56840: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH25512%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for HH25512: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for EB00697: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: TW92220
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW92220%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for TW92220: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for YX65431: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK25360%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for ZK25360: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM74497%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for WM74497: 0
2026-03-20 10:23:25 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-20 10:23:25 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-20 10:23:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:28 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:28 [auto1.nl] INFO: Found listing with ID: TV92661
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV92661%27 HTTP/1.1" 200 None
2026-03-20 10:23:28 [auto1.nl] INFO: Scrape type for TV92661: 0
2026-03-20 10:23:28 [auto1.nl] INFO: Found listing with ID: NP75308
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP75308%27 HTTP/1.1" 200 None
2026-03-20 10:23:28 [auto1.nl] INFO: Scrape type for NP75308: 0
2026-03-20 10:23:28 [auto1.nl] INFO: Found listing with ID: GG50012
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG50012%27 HTTP/1.1" 200 None
2026-03-20 10:23:28 [auto1.nl] INFO: Scrape type for GG50012: 0
2026-03-20 10:23:28 [auto1.nl] INFO: Found listing with ID: VU67203
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU67203%27 HTTP/1.1" 200 None
2026-03-20 10:23:28 [auto1.nl] INFO: Scrape type for VU67203: 0
2026-03-20 10:23:28 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-20 10:23:28 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-20 10:23:28 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-20 10:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA08041%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for LA08041: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: JV55653
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JV55653%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for JV55653: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: XP09088
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP09088%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for XP09088: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for GA63942: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: XS30308
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XS30308%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for XS30308: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for SY92282: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for BM26306: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG13282%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for BG13282: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW21106%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for GW21106: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: PA41157
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA41157%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for PA41157: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: EJ28284
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ28284%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for EJ28284: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: VF94188
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF94188%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for VF94188: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG23592%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for WG23592: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: LC82403
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC82403%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for LC82403: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62268%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for HX62268: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: EK15803
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK15803%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for EK15803: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: PL93533
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL93533%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for PL93533: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for DU10654: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: MW64988
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW64988%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for MW64988: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for NX47084: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for WG27101: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV28211%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for TV28211: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: JX45926
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX45926%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for JX45926: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: EJ50913
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ50913%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for EJ50913: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for FB29349: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL71745%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for SL71745: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: VF41372
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF41372%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for VF41372: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: SD34015
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD34015%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for SD34015: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: VA80208
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA80208%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for VA80208: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB08844%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for EB08844: 0
2026-03-20 10:23:29 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-20 10:23:29 [auto1.nl] INFO: Scrape type for RX96199: 0
2026-03-20 10:23:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:30 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: KG23928
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG23928%27 HTTP/1.1" 200 None
2026-03-20 10:23:30 [auto1.nl] INFO: Scrape type for KG23928: 0
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY24262%27 HTTP/1.1" 200 None
2026-03-20 10:23:30 [auto1.nl] INFO: Scrape type for PY24262: 0
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: GS48011
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS48011%27 HTTP/1.1" 200 None
2026-03-20 10:23:30 [auto1.nl] INFO: Scrape type for GS48011: 0
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: HM64059
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM64059%27 HTTP/1.1" 200 None
2026-03-20 10:23:30 [auto1.nl] INFO: Scrape type for HM64059: 0
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: SF92286
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SF92286%27 HTTP/1.1" 200 None
2026-03-20 10:23:30 [auto1.nl] INFO: Scrape type for SF92286: 0
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR95179%27 HTTP/1.1" 200 None
2026-03-20 10:23:30 [auto1.nl] INFO: Scrape type for NR95179: 0
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: FM80786
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM80786%27 HTTP/1.1" 200 None
2026-03-20 10:23:30 [auto1.nl] INFO: Scrape type for FM80786: 0
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-20 10:23:30 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-20 10:23:30 [auto1.nl] INFO: Scrape type for SG18673: 0
2026-03-20 10:23:30 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: WG88878
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG88878%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for WG88878: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX54730%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for NX54730: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY11680%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for BY11680: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: CE38592
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE38592%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for CE38592: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for VR09113: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG59138%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for NG59138: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for UR39080: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: ND76510
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND76510%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for ND76510: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: UP10954
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP10954%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for UP10954: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: XF31929
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF31929%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for XF31929: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: BA15216
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA15216%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for BA15216: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: CG11712
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG11712%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for CG11712: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for AW17903: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: MB05739
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB05739%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for MB05739: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: TG38127
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG38127%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for TG38127: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV89778%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for VV89778: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for MW67597: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY66252%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for GY66252: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for TH29476: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: RV44939
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RV44939%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for RV44939: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: ZA85303
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA85303%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for ZA85303: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: DM49245
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM49245%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for DM49245: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for ND88147: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: DB35159
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB35159%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for DB35159: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: MX43508
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX43508%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for MX43508: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: SV30356
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV30356%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for SV30356: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: KM02956
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM02956%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for KM02956: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: CT46548
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT46548%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for CT46548: 0
2026-03-20 10:23:31 [auto1.nl] INFO: Found listing with ID: KW55792
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW55792%27 HTTP/1.1" 200 None
2026-03-20 10:23:31 [auto1.nl] INFO: Scrape type for KW55792: 0
2026-03-20 10:23:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:32 [scrapy.extensions.logstats] INFO: Crawled 103 pages (at 9 pages/min), scraped 94 items (at 1 items/min)
2026-03-20 10:23:32 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-20 10:23:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:33 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:33 [auto1.nl] INFO: Found listing with ID: YV28666
2026-03-20 10:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV28666%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for YV28666: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: BA20726
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA20726%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for BA20726: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for CY78777: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: YT17806
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT17806%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for YT17806: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: TV97350
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV97350%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for TV97350: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: TX69728
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TX69728%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for TX69728: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME79677%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for ME79677: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: VR98847
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR98847%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for VR98847: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: LC34578
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC34578%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for LC34578: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: LJ29436
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ29436%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for LJ29436: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: VF69910
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF69910%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for VF69910: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: WK96940
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK96940%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for WK96940: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: KY41956
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KY41956%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for KY41956: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: PT21258
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT21258%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for PT21258: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: JN66763
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN66763%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for JN66763: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: LV75014
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LV75014%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for LV75014: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for PE89486: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: MU61846
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU61846%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for MU61846: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: CF89454
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF89454%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for CF89454: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: MX65590
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX65590%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for MX65590: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: NX06020
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX06020%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for NX06020: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: GV35300
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV35300%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for GV35300: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: GT72444
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT72444%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for GT72444: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: LA06731
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA06731%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for LA06731: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for JF28004: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: CD30101
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD30101%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for CD30101: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for RY80321: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: AB91317
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB91317%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for AB91317: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: SB41881
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB41881%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for SB41881: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: SK70021
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK70021%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for SK70021: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: HL59517
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL59517%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for HL59517: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: RM14364
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM14364%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for RM14364: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: NY22066
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY22066%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for NY22066: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: SE16828
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE16828%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for SE16828: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: EY89733
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY89733%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for EY89733: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: UF27359
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF27359%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for UF27359: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: XV86839
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86839%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for XV86839: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: MZ05737
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ05737%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for MZ05737: 0
2026-03-20 10:23:34 [auto1.nl] INFO: Found listing with ID: UZ85688
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UZ85688%27 HTTP/1.1" 200 None
2026-03-20 10:23:34 [auto1.nl] INFO: Scrape type for UZ85688: 0
2026-03-20 10:23:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:39 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: KK04349
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK04349%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for KK04349: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: LE86086
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE86086%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for LE86086: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: DR68176
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR68176%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for DR68176: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: DR41045
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR41045%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for DR41045: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: UZ24790
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UZ24790%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for UZ24790: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: UA86976
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA86976%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for UA86976: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: XS35252
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XS35252%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for XS35252: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: US84379
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US84379%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for US84379: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: TP11122
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP11122%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for TP11122: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: VD03241
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03241%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for VD03241: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: ZY93041
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY93041%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for ZY93041: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: YJ93936
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ93936%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for YJ93936: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for ZG49112: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: KJ49026
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ49026%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for KJ49026: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for AM42063: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: CP38443
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP38443%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for CP38443: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: YT28903
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT28903%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for YT28903: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: XF10444
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF10444%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for XF10444: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: CC61137
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC61137%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for CC61137: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: RB40697
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RB40697%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for RB40697: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: MU78869
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU78869%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for MU78869: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: JR03382
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR03382%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for JR03382: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG04233%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for BG04233: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for YA06880: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: MM63148
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM63148%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for MM63148: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: EC44613
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC44613%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for EC44613: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: PN52366
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN52366%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for PN52366: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: FW73564
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW73564%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for FW73564: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: BN20841
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN20841%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for BN20841: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: DB89526
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB89526%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for DB89526: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: PT85838
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT85838%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for PT85838: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: SH64324
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SH64324%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for SH64324: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW03238%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for AW03238: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: VH78180
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH78180%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for VH78180: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: AR85055
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR85055%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for AR85055: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for LT65669: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for YD79188: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: WS85208
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS85208%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for WS85208: 0
2026-03-20 10:23:39 [auto1.nl] INFO: Found listing with ID: YV44857
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV44857%27 HTTP/1.1" 200 None
2026-03-20 10:23:39 [auto1.nl] INFO: Scrape type for YV44857: 0
2026-03-20 10:23:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:48 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:48 [auto1.nl] INFO: Found listing with ID: MX79285
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX79285%27 HTTP/1.1" 200 None
2026-03-20 10:23:48 [auto1.nl] INFO: Scrape type for MX79285: 0
2026-03-20 10:23:48 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-20 10:23:48 [auto1.nl] INFO: Scrape type for NT73578: 0
2026-03-20 10:23:48 [auto1.nl] INFO: Found listing with ID: GS38448
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS38448%27 HTTP/1.1" 200 None
2026-03-20 10:23:48 [auto1.nl] INFO: Scrape type for GS38448: 0
2026-03-20 10:23:48 [auto1.nl] INFO: Found listing with ID: VZ53985
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ53985%27 HTTP/1.1" 200 None
2026-03-20 10:23:48 [auto1.nl] INFO: Scrape type for VZ53985: 0
2026-03-20 10:23:48 [auto1.nl] INFO: Found listing with ID: FR68171
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68171%27 HTTP/1.1" 200 None
2026-03-20 10:23:48 [auto1.nl] INFO: Scrape type for FR68171: 0
2026-03-20 10:23:48 [auto1.nl] INFO: Found listing with ID: PA73229
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA73229%27 HTTP/1.1" 200 None
2026-03-20 10:23:48 [auto1.nl] INFO: Scrape type for PA73229: 0
2026-03-20 10:23:48 [auto1.nl] INFO: Found listing with ID: FL44315
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL44315%27 HTTP/1.1" 200 None
2026-03-20 10:23:48 [auto1.nl] INFO: Scrape type for FL44315: 0
2026-03-20 10:23:48 [auto1.nl] INFO: Found listing with ID: XE39844
2026-03-20 10:23:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XE39844%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for XE39844: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: TX08379
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TX08379%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for TX08379: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: LA27947
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA27947%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for LA27947: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: BY82778
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY82778%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for BY82778: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: DZ88796
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ88796%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for DZ88796: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: FK19827
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK19827%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for FK19827: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: ZM19460
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZM19460%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for ZM19460: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: EK37526
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK37526%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for EK37526: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: KC57622
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC57622%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for KC57622: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: ED96243
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ED96243%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for ED96243: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: AH55671
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AH55671%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for AH55671: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: ZJ72169
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ72169%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for ZJ72169: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: VK82008
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK82008%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for VK82008: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: UZ41940
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UZ41940%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for UZ41940: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: WT22741
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WT22741%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for WT22741: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: FP99208
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP99208%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for FP99208: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: BY06610
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY06610%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for BY06610: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: ZJ80966
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ80966%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for ZJ80966: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for ZK31432: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: KN16427
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KN16427%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for KN16427: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW60386%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for MW60386: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: DA24355
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA24355%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for DA24355: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: MG04453
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MG04453%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for MG04453: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: JR20080
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR20080%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for JR20080: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: YR17925
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR17925%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for YR17925: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: CK61376
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK61376%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for CK61376: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: UH05852
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH05852%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for UH05852: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: BE37168
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE37168%27 HTTP/1.1" 200 None
2026-03-20 10:23:49 [auto1.nl] INFO: Scrape type for BE37168: 0
2026-03-20 10:23:49 [auto1.nl] INFO: Found listing with ID: WA13538
2026-03-20 10:23:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA13538%27 HTTP/1.1" 200 None
2026-03-20 10:23:50 [auto1.nl] INFO: Scrape type for WA13538: 0
2026-03-20 10:23:50 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-20 10:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-20 10:23:50 [auto1.nl] INFO: Scrape type for CN90357: 0
2026-03-20 10:23:50 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-20 10:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-20 10:23:50 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-20 10:23:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:53 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:53 [auto1.nl] INFO: Found listing with ID: XH33240
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH33240%27 HTTP/1.1" 200 None
2026-03-20 10:23:53 [auto1.nl] INFO: Scrape type for XH33240: 0
2026-03-20 10:23:53 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-20 10:23:53 [auto1.nl] INFO: Scrape type for WW80908: 0
2026-03-20 10:23:53 [auto1.nl] INFO: Found listing with ID: NA57563
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA57563%27 HTTP/1.1" 200 None
2026-03-20 10:23:53 [auto1.nl] INFO: Scrape type for NA57563: 0
2026-03-20 10:23:53 [auto1.nl] INFO: Found listing with ID: GD03233
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD03233%27 HTTP/1.1" 200 None
2026-03-20 10:23:53 [auto1.nl] INFO: Scrape type for GD03233: 0
2026-03-20 10:23:53 [auto1.nl] INFO: Found listing with ID: CR56917
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR56917%27 HTTP/1.1" 200 None
2026-03-20 10:23:53 [auto1.nl] INFO: Scrape type for CR56917: 0
2026-03-20 10:23:53 [auto1.nl] INFO: Found listing with ID: GU72646
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU72646%27 HTTP/1.1" 200 None
2026-03-20 10:23:53 [auto1.nl] INFO: Scrape type for GU72646: 0
2026-03-20 10:23:53 [auto1.nl] INFO: Found listing with ID: AH82142
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AH82142%27 HTTP/1.1" 200 None
2026-03-20 10:23:53 [auto1.nl] INFO: Scrape type for AH82142: 0
2026-03-20 10:23:53 [auto1.nl] INFO: Found listing with ID: FF20572
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF20572%27 HTTP/1.1" 200 None
2026-03-20 10:23:53 [auto1.nl] INFO: Scrape type for FF20572: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: BD87228
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD87228%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for BD87228: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: UZ49747
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UZ49747%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for UZ49747: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: BB30302
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB30302%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for BB30302: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: HH63171
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH63171%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for HH63171: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: HY56425
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY56425%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for HY56425: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: DZ17172
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ17172%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for DZ17172: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: UG49724
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG49724%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for UG49724: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: TY10143
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY10143%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for TY10143: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: ZG42486
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG42486%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for ZG42486: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: TW75776
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW75776%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for TW75776: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: RV88170
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RV88170%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for RV88170: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: XF27048
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF27048%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for XF27048: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: MV82758
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV82758%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for MV82758: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: VC25244
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC25244%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for VC25244: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: RH89754
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH89754%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for RH89754: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: YE34591
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE34591%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for YE34591: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: CH49337
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH49337%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for CH49337: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: MT38963
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT38963%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for MT38963: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW61331%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for VW61331: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: ML39469
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML39469%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for ML39469: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: FC19497
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC19497%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for FC19497: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG79878%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for UG79878: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: KC35372
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC35372%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for KC35372: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: XC26708
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC26708%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for XC26708: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: KN46447
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KN46447%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for KN46447: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC51093%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for MC51093: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: SM09418
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM09418%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for SM09418: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: VL80786
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80786%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for VL80786: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: KM26805
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM26805%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for KM26805: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: FX43297
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX43297%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for FX43297: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: XH84499
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH84499%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for XH84499: 0
2026-03-20 10:23:54 [auto1.nl] INFO: Found listing with ID: UH39529
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH39529%27 HTTP/1.1" 200 None
2026-03-20 10:23:54 [auto1.nl] INFO: Scrape type for UH39529: 0
2026-03-20 10:23:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:23:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:23:59 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 1055 | hits on page: 40
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: UN11563
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UN11563%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for UN11563: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: EC94380
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC94380%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for EC94380: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: VK57088
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK57088%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for VK57088: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: JY14630
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY14630%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for JY14630: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: HE68335
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HE68335%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for HE68335: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: EN76108
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN76108%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for EN76108: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: MC95226
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC95226%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for MC95226: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: CL07612
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL07612%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for CL07612: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: UU85421
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU85421%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for UU85421: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: BN81433
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN81433%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for BN81433: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: AG60358
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG60358%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for AG60358: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: CV91211
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV91211%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for CV91211: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: WW00953
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW00953%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for WW00953: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: RU90437
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RU90437%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for RU90437: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: PW39034
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PW39034%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for PW39034: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: ZY13859
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY13859%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for ZY13859: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: FR92202
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR92202%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for FR92202: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: WX02305
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX02305%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for WX02305: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: XK49150
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK49150%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for XK49150: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA41421%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for CA41421: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: TV63591
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV63591%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for TV63591: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: BV93100
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV93100%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for BV93100: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: VE90401
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE90401%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for VE90401: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: RL70309
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL70309%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for RL70309: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: XH15152
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH15152%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for XH15152: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR13994%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for AR13994: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX02996%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for BX02996: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: VL34628
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL34628%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for VL34628: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: WZ88941
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ88941%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for WZ88941: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: MC18243
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC18243%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for MC18243: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: JL94248
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL94248%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for JL94248: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: AX70589
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX70589%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for AX70589: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG41463%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for CG41463: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH55431%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for KH55431: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: WP36870
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP36870%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for WP36870: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: EJ42585
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ42585%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for EJ42585: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: KS49280
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KS49280%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for KS49280: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: UX35743
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UX35743%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for UX35743: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: GU23024
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU23024%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for GU23024: 0
2026-03-20 10:23:59 [auto1.nl] INFO: Found listing with ID: UG47676
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:23:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG47676%27 HTTP/1.1" 200 None
2026-03-20 10:23:59 [auto1.nl] INFO: Scrape type for UG47676: 0
2026-03-20 10:23:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:24:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:24:07 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 1055 | hits on page: 40
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: DU06840
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU06840%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for DU06840: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ14164%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for BZ14164: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: CL15006
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL15006%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for CL15006: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: UN94837
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UN94837%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for UN94837: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: ZF10261
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZF10261%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for ZF10261: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ31943%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for SZ31943: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: HV09549
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV09549%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for HV09549: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: GV84229
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV84229%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for GV84229: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: DG80462
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG80462%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for DG80462: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG19961%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for PG19961: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: CK20661
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK20661%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for CK20661: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: HL22035
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL22035%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for HL22035: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: LS22530
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS22530%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for LS22530: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: YX18803
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX18803%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for YX18803: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: CZ15869
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CZ15869%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for CZ15869: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: DZ53599
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ53599%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for DZ53599: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: VM58472
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM58472%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for VM58472: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: RS09587
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RS09587%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for RS09587: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: XY01430
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY01430%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for XY01430: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: FH18531
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH18531%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for FH18531: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: NA72528
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA72528%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for NA72528: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: VK83844
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK83844%27 HTTP/1.1" 200 None
2026-03-20 10:24:07 [auto1.nl] INFO: Scrape type for VK83844: 0
2026-03-20 10:24:07 [auto1.nl] INFO: Found listing with ID: YP06208
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP06208%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for YP06208: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: NZ82309
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ82309%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for NZ82309: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: DH25973
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH25973%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for DH25973: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: HW65119
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW65119%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for HW65119: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: FB87464
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB87464%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for FB87464: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: YU62041
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU62041%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for YU62041: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: SR47127
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR47127%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for SR47127: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: VW09729
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW09729%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for VW09729: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: SV52405
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV52405%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for SV52405: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: AP41268
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AP41268%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for AP41268: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: HE27738
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HE27738%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for HE27738: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: WU69480
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU69480%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for WU69480: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: ET61539
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET61539%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for ET61539: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: SR76434
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR76434%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for SR76434: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: XT71834
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XT71834%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for XT71834: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: XV70610
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV70610%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for XV70610: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: LK04659
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK04659%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for LK04659: 0
2026-03-20 10:24:08 [auto1.nl] INFO: Found listing with ID: US07368
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US07368%27 HTTP/1.1" 200 None
2026-03-20 10:24:08 [auto1.nl] INFO: Scrape type for US07368: 0
2026-03-20 10:24:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:24:32 [scrapy.extensions.logstats] INFO: Crawled 109 pages (at 6 pages/min), scraped 94 items (at 0 items/min)
2026-03-20 10:24:32 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-20 10:24:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:24:45 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 1055 | hits on page: 40
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: NA46386
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA46386%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for NA46386: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: MN73668
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN73668%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for MN73668: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: TP39186
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP39186%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for TP39186: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: RP02130
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP02130%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for RP02130: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: HT91861
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT91861%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for HT91861: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE73966%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for SE73966: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: CY21734
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY21734%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for CY21734: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: RK90164
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK90164%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for RK90164: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for DD48612: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: JV88732
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JV88732%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for JV88732: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: HH59991
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59991%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for HH59991: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: PS06381
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS06381%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for PS06381: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: NL82021
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL82021%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for NL82021: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: RP05834
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP05834%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for RP05834: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: CX53389
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX53389%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for CX53389: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for WP58537: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: CE33156
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE33156%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for CE33156: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: AY98199
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY98199%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for AY98199: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: WR49361
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR49361%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for WR49361: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: SA12975
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA12975%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for SA12975: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: DD99999
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD99999%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for DD99999: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: KK03739
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK03739%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for KK03739: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for BY07410: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: LE06862
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06862%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for LE06862: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: BX19606
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX19606%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for BX19606: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: VG82378
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VG82378%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for VG82378: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: ZH96401
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZH96401%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for ZH96401: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for UF88780: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: VF08835
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF08835%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for VF08835: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC01356%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for AC01356: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: JY48975
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY48975%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for JY48975: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-20 10:24:45 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-20 10:24:45 [auto1.nl] INFO: Found listing with ID: VB53474
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB53474%27 HTTP/1.1" 200 None
2026-03-20 10:24:46 [auto1.nl] INFO: Scrape type for VB53474: 0
2026-03-20 10:24:46 [auto1.nl] INFO: Found listing with ID: HR63180
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR63180%27 HTTP/1.1" 200 None
2026-03-20 10:24:46 [auto1.nl] INFO: Scrape type for HR63180: 0
2026-03-20 10:24:46 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-20 10:24:46 [auto1.nl] INFO: Scrape type for WE00434: 0
2026-03-20 10:24:46 [auto1.nl] INFO: Found listing with ID: KH44977
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH44977%27 HTTP/1.1" 200 None
2026-03-20 10:24:46 [auto1.nl] INFO: Scrape type for KH44977: 0
2026-03-20 10:24:46 [auto1.nl] INFO: Found listing with ID: GM90003
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM90003%27 HTTP/1.1" 200 None
2026-03-20 10:24:46 [auto1.nl] INFO: Scrape type for GM90003: 0
2026-03-20 10:24:46 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-20 10:24:46 [auto1.nl] INFO: Scrape type for TE70578: 0
2026-03-20 10:24:46 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-20 10:24:46 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-20 10:24:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:24:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:24:47 [auto1.nl] INFO: Channel: 24h | Page: 25 | totalHits: 1055 | hits on page: 40
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: AE75222
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE75222%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for AE75222: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: DT78754
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT78754%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for DT78754: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for DN96174: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: RP03468
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP03468%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for RP03468: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: US67635
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US67635%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for US67635: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for JM47469: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: FH83713
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH83713%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for FH83713: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: NY68824
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY68824%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for NY68824: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: JL79929
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL79929%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for JL79929: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: PP90291
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP90291%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for PP90291: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: XB00742
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XB00742%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for XB00742: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM47540%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for RM47540: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: VM51051
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM51051%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for VM51051: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: JY34303
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY34303%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for JY34303: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: LC66252
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC66252%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for LC66252: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: PU11309
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU11309%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for PU11309: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: CU47397
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU47397%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for CU47397: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: NA70537
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA70537%27 HTTP/1.1" 200 None
2026-03-20 10:24:47 [auto1.nl] INFO: Scrape type for NA70537: 0
2026-03-20 10:24:47 [auto1.nl] INFO: Found listing with ID: GW12777
2026-03-20 10:24:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW12777%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for GW12777: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX09180%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for CX09180: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: MY15025
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY15025%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for MY15025: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: MZ86084
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ86084%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for MZ86084: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: LU90858
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU90858%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for LU90858: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: NP49029
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP49029%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for NP49029: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: FX03577
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX03577%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for FX03577: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: BR22698
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR22698%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for BR22698: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for AZ42388: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: AE93572
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE93572%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for AE93572: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB25892%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for YB25892: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: YY02684
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YY02684%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for YY02684: 0
2026-03-20 10:24:48 [auto1.nl] INFO: Found listing with ID: MT73656
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73656%27 HTTP/1.1" 200 None
2026-03-20 10:24:48 [auto1.nl] INFO: Scrape type for MT73656: 0
2026-03-20 10:24:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:24:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:24:49 [auto1.nl] INFO: Channel: 24h | Page: 26 | totalHits: 1055 | hits on page: 40
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: UX14376
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UX14376%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for UX14376: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: ZG94875
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG94875%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for ZG94875: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: TG76048
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG76048%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for TG76048: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX19183%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for KX19183: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: SX92969
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX92969%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for SX92969: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: PM01887
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM01887%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for PM01887: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: PV45272
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV45272%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for PV45272: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: JS53936
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS53936%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for JS53936: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: JZ93383
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ93383%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for JZ93383: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: ZD76233
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD76233%27 HTTP/1.1" 200 None
2026-03-20 10:24:49 [auto1.nl] INFO: Scrape type for ZD76233: 0
2026-03-20 10:24:49 [auto1.nl] INFO: Found listing with ID: JS74579
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS74579%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for JS74579: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: AA17574
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA17574%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for AA17574: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: ST75918
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST75918%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for ST75918: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: FK36702
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK36702%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for FK36702: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: YW38508
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW38508%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for YW38508: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: XR60693
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR60693%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for XR60693: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for TM57044: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: ES98904
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES98904%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for ES98904: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: FB05364
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB05364%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for FB05364: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: LR51594
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR51594%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for LR51594: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: VU11116
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU11116%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for VU11116: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: EF01238
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF01238%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for EF01238: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: CG64663
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG64663%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for CG64663: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: PJ67365
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ67365%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for PJ67365: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: SF81244
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SF81244%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for SF81244: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: CP85756
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP85756%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for CP85756: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: UR81548
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR81548%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for UR81548: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: NF89493
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF89493%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for NF89493: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC52581%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for TC52581: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: YV35561
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV35561%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for YV35561: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: FS10524
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS10524%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for FS10524: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: PA93170
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA93170%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for PA93170: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for TA68954: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for ZP63684: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: GM59305
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM59305%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for GM59305: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: RZ24490
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RZ24490%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for RZ24490: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: CG02980
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG02980%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for CG02980: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: ZA94947
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA94947%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for ZA94947: 0
2026-03-20 10:24:50 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-20 10:24:50 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-20 10:24:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:24:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:24:51 [auto1.nl] INFO: Channel: 24h | Page: 27 | totalHits: 1055 | hits on page: 15
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: GG84538
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG84538%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for GG84538: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: KE60550
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE60550%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for KE60550: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: GM01585
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM01585%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for GM01585: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: WN54022
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN54022%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for WN54022: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: WY83995
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY83995%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for WY83995: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: RE93496
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RE93496%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for RE93496: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for JB09830: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: XB65271
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XB65271%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for XB65271: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: FA90105
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA90105%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for FA90105: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for WH58354: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: CR73956
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR73956%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for CR73956: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: HC35521
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC35521%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for HC35521: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: AJ14031
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ14031%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for AJ14031: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: VF99410
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF99410%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for VF99410: 0
2026-03-20 10:24:51 [auto1.nl] INFO: Found listing with ID: ST75697
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST75697%27 HTTP/1.1" 200 None
2026-03-20 10:24:51 [auto1.nl] INFO: Scrape type for ST75697: 0
2026-03-20 10:24:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-20 10:24:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-20 10:24:54 [auto1.nl] INFO: Channel: 24h | Page: 28 | totalHits: 1055 | hits on page: 0
2026-03-20 10:24:54 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-20 10:24:54 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 655, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-20 10:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-20 10:24:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201773570294 HTTP/1.1" 200 None
2026-03-20 10:24:54 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (94 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/2026-03-20T10_18_27.jl
2026-03-20 10:24:54 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 572228,
 'downloader/request_count': 326,
 'downloader/request_method_count/GET': 296,
 'downloader/request_method_count/POST': 30,
 'downloader/response_bytes': 48702900,
 'downloader/response_count': 326,
 'downloader/response_status_count/200': 326,
 'dupefilter/filtered': 24,
 'elapsed_time_seconds': 382.118311,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 20, 10, 24, 54, 660641, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 94,
 'log_count/DEBUG': 4800,
 'log_count/INFO': 4649,
 'memusage/max': 194719744,
 'memusage/startup': 147787776,
 'photo_download_count': 212,
 'request_depth_max': 31,
 'response_received_count': 114,
 'scheduler/dequeued': 326,
 'scheduler/dequeued/memory': 326,
 'scheduler/enqueued': 326,
 'scheduler/enqueued/memory': 326,
 'scrape_type/new': 41,
 'scrape_type/price_update': 53,
 'scrape_type/skipped': 977,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 116,
 'scrapy-zyte-api/error_ratio': 0.017241379310344827,
 'scrapy-zyte-api/errors': 2,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 2,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.623481503115933,
 'scrapy-zyte-api/mean_response_seconds': 5.654370594344902,
 'scrapy-zyte-api/processed': 114,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 114,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 113,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 114,
 'scrapy-zyte-api/request_args/httpRequestBody': 30,
 'scrapy-zyte-api/request_args/httpRequestMethod': 30,
 'scrapy-zyte-api/request_args/httpResponseBody': 114,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 114,
 'scrapy-zyte-api/request_args/sessionContext': 114,
 'scrapy-zyte-api/request_args/url': 114,
 'scrapy-zyte-api/status_codes/0': 2,
 'scrapy-zyte-api/status_codes/200': 114,
 'scrapy-zyte-api/success': 114,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1095,
 'source/total_available': 1055,
 'start_time': datetime.datetime(2026, 3, 20, 10, 18, 32, 542330, tzinfo=datetime.timezone.utc)}
2026-03-20 10:24:54 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-20 10:24:54 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7faf83a95a90>
2026-03-20 10:24:54 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7faf83bc77d0>